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(54) Terabit per second packet switch 

(57) A physically realizable one terabit or more ATM 
packet switch 1 0A that has a large number of input inter- 
faces connected to a single stage switching fabric 14A 
which is in turn connected to a number of output modules 
16o-16 m . according to the generic growable packet 
switch architecture. This ATM packet switch 10A is dif- 
ferent from other growable packet switches in that it has 
a single stage switch fabric (14A or 14B) controlled by 
an out-of-band controller 20, yet it has significantly 
reduced complexity with respect to comparably sized 
electronic crossbar switches or their isomorphs. This 
ATM packet switch architecture is so flexible, it can be 
extended to provide variable length packets, circuit 
switched connections and fault tolerant redundant cir- 
cuits using the same switch fabric and out-of-band con- 
troller architectures. 




CM 
< 
CO 



o 

CM 

o 

Q_ 



EP0 720 413 A2 



Description 
Technical Field 

The invention relates to large telecommunication switches and more particularly to large telecommunication switches 
that use data packets in order to communicate at aggregate throughputs at the one terabit per second level. 

Description of the Prior Art 

Telecommunications have long used digital switching to encode, multiplex, transmit and decode audio frequencies 
in order to carry the millions of telephone voice calls of the world. Telecommunication switches for voice calls have grown 
to very large sizes to keep pace with demand. Most of the switching systems that route and control voice call traffic are 
called circuit switches, which means that for each call a type of bi-directional circuit, usually audio is set up between the 
calling party and the called parry. The circuit that is set up has the bandwidth and transport timing necessary to simulate 
a face-to-face conversation without distortion or time delays that are objectionable to the parties. 

An alternative to circuit switching is called packet switching. For packet switching, the calling parry is responsible 
for converting the information into one or more packets. This information could be encoded voice, it could be encoded 
computer data, or it could be encoded video. A number to guide the packet to its destination, i.e. the called party, is 
typically included in a packet header. The packet switching network then has the task of routing each packet to its 
respective destination without undue distortion or delay. The called party usually has the equipment to receive the packets 
and decode the information back into an appropriate form. 

The extremely rapid growth of packet switching traffic carrying voice, computer (LAN/WAN) , facsimile, image and 
video data to an ever widening variety of locations, along with the proposals of the Information Infrastructure, has chal- 
lenged both the present packet switch system architectures and protocols. 

Many vendors and service providers have joined forces to define a global standard that permits packet switching 
services to be provided in a ubiquitous fashion. The result of this coordinated effort by the industry has been the rapid 
development and deployment of an Asynchronous Transfer Mode (ATM) as a standard means of efficiently routing and 
transporting data packets that have stochastically-distributed arrival rates according to the recent ATM standard. ATM 
is thus a packet-oriented standard, but unlike most of its data packet predecessors (X.25, frame relay, etc.), ATM uses 
short, fixed-length, 53-byte packets that are also known as cells. ATM also uses a very streamlined form of error recovery 
and flow control relative to its predecessors. In fact, the ATM standard essentially eliminates most error protection and 
flow control at the link level, leaving these functions to higher level protocols at the edges of the network. This approach 
permits rapid routing of the short cells with minimal network delay and jitter, making ATM compatible with voice, data 
and video services. ATM has been embraced by the computer, LAN, and WAN industries, so a seamless packet com- 
munication from the source computer through LANs, WANs, and the public-switched network is already a reality. 

If this level of connectivity becomes available to the average consumer and if advanced broad band services that 
combine voice, broadband data and video are similarly available at reasonable prices, then the volume of ATM traffic 
that may be generated in the future is virtually limitless. As a result, the number and size of the switches and cross- 
connects required to route the projected ATM packet traffic may also grow by phenomenal rates within the next decade. 
ATM switches and cross-connects for toll and gateway applications may require aggregate bandwidths ranging from 1 55 
gigabits per second (1000 inputs at SONET OC-3 155 Mbps rates) to 2.4 terabits per second (1000 inputs at SONET 
OC-48 2.4 gigabits per second rates). Additionally, if demand for broadband services to the home and LAN/WAN con- 
nectivity through the public-switched network grows as some experts believe, then local telephone exchange carriers 
may install ATM switches and cross-connects for metropolitan area network (MAN) applications having aggregate band- 
widths ranging from 100 Gigabits per second to 775 Gigabits per second. 

By necessity, most of the current architectural research and hardware/software development for ATM switches has 
concentrated on switches with much smaller aggregate bandwidths which meet the more near-term needs of the mar- 
ketplace. For example, most projections within the LANA/VAN community require aggregate bandwidths ranging from 
150 Mbps to 12 Gigabits per second, and most of the published proposals within the telecommunications industry call 
for aggregate bandwidths ranging from 20 Gigabits per second to 160 Gigabits per second. Most of these ATM packet 
switching architectures do not scale up to larger sizes. Scaling up present ATM switching architectures produce systems 
that are cost prohibitive, size prohibitive, and/or physically unrealizable because of limits of the underlying technology. 

For example, very common designs for large, high-throughput switches use a multi-stage interconnection network 
containing multiple stages of switching nodes (node-stages) interconnected by stages of links (link-stages) to provide 
multiple paths between input ports and output ports. Clos, Banyan and Benes networks are examples of such networks. 
A multiple stage network design can yield networks with very high levels of performance (low blocking probabilities, low 
delay, high degrees of fault tolerance, etc.), and may result in low system-level costs, because network resources (nodes 
and links) are time-shared by the many different paths that can be set up within the network. Physically realizing a 
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multistage network for a large throughput ATM packet switch is, however, a problem because of the time and processing 
power required by routing determinations. 

Any large, high-throughput ATM switching architecture must address two fundamental issues that profoundly effect 
the overall performance of the resulting ATM switch. The first of these issues is cell loss due to blocking within the internal 

5 links of the distribution network (also known as the switching fabric), and the second is cell loss due to contention for 
output ports by two or more ATM cells that pass through the switch at the same moment in time. The first issue can 
usually be solved by designing a network with sufficient switching fabric (nodes and links) such that multiple paths exist 
between input ports and output ports. As a result, if two or more ATM cells attempt to use the same shared resource 
(nodes or links) within the switching fabric, each of the cells can usually find a path, thereby eliminating most of the 

jo internal network blocking problem. The second issue requires some type of method and apparatus for handling cells 
simultaneously arriving at the same output port. 

A general technique for a switch to handle cells destined for the same output port is analyzed in an article, A Growable 
Packet Switch Architecture, IEEE Transactions on Communications, February, 1992, by Eng et al. and in another article 
The Knockout Switch, ISS AT&T Technical Papers, 1987, by Yeh et al. This general design technique, as shown in Fig. 

75 1 , segments a packet switch into two distinct parts. An Nx(FN) distribution network (which provides for N input ports) 
and a bank of K mxn output packet modules (which provide for a total of M=Kn output ports). Given that each of the 
links emanating from the distribution network is required to be terminated at one of the inputs to one of the output packet 
modules, it can be seen that the equation FN=Km must be satisfied. In the switch shown in FIG. 1 , the switching fabric 
is a memory-less Nx(FN) fanout switch whose function is to route an arriving ATM cell to any of the m inputs on the 

20 output packet module connected to the cell's desired output port. The output packet module is a mxn switch with buffers 
that are available for storing cells that must be delayed when two or more cells contend for a particular output port. If 
the arriving traffic is uniformly distributed across all output ports and if the buffers within the output packet modules are 
sufficiently large, then the ratio m:n can always be chosen large enough to force the cell loss probability within the 
network to be below any desired cell loss probability level. In fact, if the network size (N) is large and if R represents the 

25 switch loading, then the cell loss probability of a network with mxn output packet modules as shown by Eng et al is given 
by: 

P(cell loss)=[1-m/(nR)] [1-£{(nfl) k e(-nR))fkr\+(nR) m e(-nR)/m\. 

30 k=0 



Existing small packet switches have acceptable cell loss probabilities of approximately 10" 12 , so any loss probability 
smaller than existing units are considered acceptable. 

35 Besides the ATM cell losses because of internal contentions, in an ATM packet switch where all of the N cells arrive 
simultaneously at the inputs of the distribution network, the cells must be processed at each stage and path hunts must 
be processed before the next group of N cells arrives at the network input ports. If for example, the incoming transmission 
lines support SONET OC-48 2.5 Gigabits per second bit-rates, then the group of N ATM cells that arrive together must 
be processed and sent on to the next stage of the pipeline every 176 nano seconds (the duration of an ATM cell on a 

40 2.5 Gigabits per second link). For large values of N, a substantial amount of processing power is therefore required to 
complete the path hunt operations for all N cells. (For an N=256, then at least 1.45x10 9 path hunts must be completed 
every second, which corresponds to an average processing rate of one path hunt every 684 pico seconds). Present 
commercial microprocessors can process approximately 100 million instructions per second. If each path hunt took only 
one instruction, these 1 .45x1 0 9 path hunts would required the total processing power of at least 1 5 such microprocessors. 

45 Thus, a path hunt controller based on something other than a single commercial microprocessor will be necessary for 
a large ATM packet switch. 

Two approaches to solving the path hunting problem can be envisioned. One approach uses in-band, i.e. self-routing, 
control techniques to perform the required path hunts. For in-band control techniques, the connection requests are 
prepended to the ATM data cells and routed through the switch along the same paths used by the following ATM payload. 

so This approach typically requires processing elements to be distributed throughout all of the nodes in the network. This 
results in relatively complicated hardware within each node of the network in order to perform localized path hunting 
operations (on only the cells that pass through that node) when determining how to route the arriving connection requests 
and ATM cells. The second approach uses out-of-band control techniques whereby the controller and switch fabric are 
logically separated with this architecture. Connection requests are routed to the path hunting controller before the control 

55 signals resulting from the path hunt are injected into the switch fabric to set the paths. This second approach requires 
that the out-of-band controller have tremendous processing power, (as mentioned above), because of the many path 
hunt operations that must be performed in a very short period of time. 

Since the path hunt operations in switches that use in-band control techniques are only based on localized traffic 
information and not on global information with respect to all of the switch traffic, the connections resulting from in-band 
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path hunting may not always be routed in optimal fashion. As a result, systems using in-band control techniques often 
require more switch fabric (stages and nodes) to provide the same operating characteristics as a less expensive switch 
based on out-of-band control techniques. In addition, out-of-band control ATM switch architectures share many similar- 
ities with the partitioning of many existing telecommunication switching and cross-connect products that have centralized 

5 controllers, so the development of a system based on a function architecture should yield fewer design problems than 
an architecture based on newer architectural approach. Thus, an out-of-band control ATM switch should benefit from 
lower overall hardware costs and have more standard architectural partitioning. On the other hand, the difficulties asso- 
ciated with performing path hunts in an out-of-band controller for N arriving ATM cells and the time required by a standard 
partitioned out-of-band controller to perform N path hunts tends to argue in favor of a newer in-band control switch 

w architecture. For example assuming a single path hunt requires at least one read from a busy-idle memory and one 
write to a busy-idle memory, N path hunts require 2N accesses to memory. If N=256, then the controller must make 51 2 
memory accesses every 1 76 nano seconds, so the average memory access time must be 340 pico seconds. Since 340 
pico seconds memories are not commercially available, a path hunt scheme different than the present standard archi- 
tectural portioning is required for any out-of band controller. 

75 The high probability that large ATM switches will be required coupled with the uncertainties and shortcomings of 
present ATM architectures demonstrate a strong need in the art for a packet switch architecture that will operate with 
throughputs at the terabit per second levels and yet may be built using components manufactured by existing semicon- 
ductor technologies Further, this architecture needs to be flexible to provide a telecommunications network that can 
evolve as customers change from non-ATM based communications to ATM based communications. 

20 

Summary of the Invention 

Briefly stated, in accordance with one aspect of the invention, an advance over the prior art is achieved by providing 
an ATM packet switch architecture having line cards with one ATM cell period storage, a single stage, reduced intercon- 

25 nects switch fabric, an out-of-band controller, and output packet modules. 

In accordance with an other aspect of the invention, an advance over the prior art is achieved by providing a packet 
switch for a switching telecommunication packet from any of a number of input lines to any of a number of output lines. 
This packet switch includes a number of input interfaces, each having an input port connected to a respective input line 
of the number of input lines and an output port. Each of the output ports is fanned out to F input ports, where F of a 

30 switching network, which has I input ports and P output ports. F is the fan-out number, which is an integer greater than 
1 , 1 is a number that is an integer multiple of the number of input lines, and P is a number that is an integer multiple of 
the number I of the input ports. The switching network is partitioned into a number, C, of pipes, where C is an integer 
having a value equal to P divided by I. A number output modules, which together have a number of output module inputs, 
are connected to P output ports of the switching network. Each of the output module inputs is connected to a respective 

35 output port of the P output ports of the switching network. The output modules together have a number plurality of 
outputs, each of these output module outputs is connected to a respective output line of said number of output lines. 
Each pipe of the C pipes has a path from each of the number of inputs lines that is connectable to a respective output 
line of the plurality of output lines. Also, the packet switch includes an out-of-band path hunter for hunting a path for a 
telecommunication packet from its respective input interface to its desired output line. 

40 in accordance with another aspect of the invention, the packet switch can increase the likelihood of successfully 
hunting a path through the switching network by providing each pipe with a switching pattern from its input ports to its 
output ports that is independent from the switching patterns of the other pipes. Furthermore, the packet switch increase 
the likelihood of successfully hunting a path through the switching network by providing preference to predetermine an 
order for packets to be selected for connection through the packet switch. 

45 

Brief Description of the Drawing 

FIG. 1 is a block diagram of a generalized growable packet switch; 
FIG. 2 is a slightly re-drawn Fig. 1 . 
so FIG. 3 is a block diagram of a growable packet switch in which the switch fabric is partitioned into L multiple pipes 
according to the present invention. 

FIG. 4 is a block diagram, similar to Fig. 3, of a specific embodiment of the present invention having four pipes (L=4) 
and showing a configuration for the pipes. 

FIG. 5 is a simplified block diagram of the embodiment shown in FIG. 4 which shows greater details of the controller. 
55 FIG 6. illustrates the timing sequences of requests to the controller shown in FIG. 5. 
FIG. 7 is a simplified block diagram of an embodiment of an output module. 

FIG. 8 is an illustrative example of rolling and its operation in a plan view of an amusement park and its satellite 
parking lots. 
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FIG. 9 shows plots of calculated values of various ATM cell loss probabilities both with and without the assignment 
of preferences. 

FIG. 10 is a simplified block diagram of a representative switch controller and its link controllers. 

FIG. 1 1 is a detailed logic diagram of a link controller. 

FIG. 12 is a state table for the link controller shown in FIG. 1 1 . 

FIGs. 1 3 A-1 3D when joined together show the operation of a switch controller in response to a sequence of requests. 
FIG. 14 illustrates the rolling of path hunting requests through a switch having four pipe controllers according to the 
present invention. 

FIG. 1 5 shows a plot of cell loss probability versus the percentage of faulty links in an ATM switch system according 
to the present invention. 

FIG. 16 is a simplified block diagram of a controller according to the present invention. 

FIG. 1 7 is a block diagram of an embodiment of the present invention which carries both STM communications and 
ATM communications. 

FIG. 18 is a block diagram, similar to Fig. 4, of a specific embodiment of the present invention having independent 
connections between each of the input interlaces and each of the four pipes (L=4) according to Galois field theory. 

Detailed Description 

Referring now to FIG. 2, a large, generalized switch 10 for ATM communications, is shown in block diagram form. 
ATM switch 10 has a number of input interfaces 12 0 - 12 N .-,, a switch fabric 14, and buffered output modules 16 0 - 16v_ 
v For ATM operation, input interfaces 12 0 - 12 N-1 , are high speed digital amplifiers that serve as a matching networks 
and power amplifiers for fanning out information received on their inputs to multiple input ports of the switch fabric 14. 
Each of the input interfaces 1 2 0 - 1 2 N .i also needs a capability to store one ATM cell, as will be explained below. Similarly 
for ATM operation, buffered output modules 16 0 -16 V -i are concentrators that are buffered to reduce packet loss when 
two or more packets are directed to and contend for the same output of outputs Outo-OutN.v 

Switch fabric 14 includes a fanout F where each of the outputs from the input interfaces 12o-12 N _i is fanned out to 
F inputs within switch fabric 14, such that if ATM switch 10 is an NxN switch then switch fabric 14 will have FN internal 
inputs and FN outputs to output modules 1 6 0 -16 v .i. Output Modules 16 0 -16vli have afanin or concentration factor of F 
in order to convert the FN outputs of the switch fabric 14 to N output module outputs Outo-OutM.-i. Each output module 
16 0 -16 V -i stores arriving ATM packets in FIFO queues, and then routes the ATM packets at the front of each of these 
FIFO queues to their desired outputs Outo-OutisM wn en the output ports are available. 

Switch fabric 1 4 is a general distribution network which may be a network of switches, specifically crossbar switches, 
to provide multiple paths from each of its input ports 17 0 -17 N .i to each of its output ports 190-1^^. However, it becomes 
highly impractical to make an NxN switch out of a single crossbar to operate as the switching component of switch fabric 
14 when the size of N exceeds 32. Thus, some other way is needed to realize the general architecture shown in FIG. 2. 

Referring now to FIG. 3, an ATM switch 10A that is both practical and possible for N inputs where the size of N is 
at least 256, is shown. Multiple paths from each input 17 0 -17 N .i through the switch fabric 14A are provided to prevent 
blocking. These multiple paths are partitioned into groups called pipes with each pipe providing exactly one path between 
each input port 17 0 -17 N .i and each output port 19 0 -19 F n-i w it nin the network. Thus, switch fabric 14A is made up of 
multiple pipes 1 8 0 -l 8 L _i . The output modules 1 6 0 -l 6v-i are essentially the same as the output modules shown in FIG. 2. 

Switch fabric 14A, is a single stage, memoryless, and non-self routing network. Since the switch fabric 14A is not 
unconditionally non-blocking as a full NxN crossbar switch would be, a controller 20 is included to hunt for a path through 
the four pipes for each ATM cell. Since each of the pipes 1 8 0 -1 83 contains a path that could transport the ATM cell, the 
real purpose of the controller 20 is to find a path that is not blocked. 

For ATM switch 10A, if the number of input lines, N is equal to 256 and if each input line is operated at a standard 
2.5 Gigabits per second data rate, its aggregate throughput will be 0.640 terabits per second. Scaling or growing such 
an ATM switch by a factor of two to 512 input lines and output lines should be straightforward and result in aggregate 
throughputs of greater than 1 Terabits per second. Scaling to an ATM switch size of 1024x1024 has been calculated to 
be within the present technology, and the architecture of the present invention is believed to be extensible even further 
as the speed of commercially available components increases and as new, faster technologies are developed. 

Referring now to FIG. 4, a specific embodiment of an ATM switch 10A is shown. In this specific embodiment ATM 
switch 10A has two hundred fifty six input interfaces 12 0 -12 2 55 which are connected to two hundred fifty-six ATM input 
lines ln 0 -ln 2 5 5 . The outputs of the input interfaces are connected to the input ports 17 0 -17 N .., of the switch fabric 14A. 
The switch fabric 14A contains a total of sixty-four 16x16 crossbar switches 15 0 -15 63 which are partitioned into four 
pipes 18 0 -18 3 . the fanout F is equal to four which if the number of output ports = FN results in 1024 output ports 19 0 - 
19io23- The output ports 19o-19 10 23 are respectively connected to the inputs of sixteen 64x16 output packet modules 
1 6 0 -1 61 5 . The sixteen 64x1 6 output packet modules are connected to two hundred fifty six outputs Outo-Out 255 . Those 
skilled in the art will recognize that other combinations of components could have been used, for example thirty two 
32x8 output modules could have been used instead of the 64x16 output modules shown in FIG. 4. 
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ATM switch 10A also has a controller 20 which has the taste of hunting and finding an available pipe through the 
switch fabric 14A for each ATM packet. The controller 20 uses the fact that the switch fabric 14A is partitioned into four 
pipes to break the pipe hunting tasks into four parallel pipe hunting tasks that are each temporally shifted by an acceptable 
amount. Details of one embodiment of such a controller 20 are shown in FIG. 5. 

For the 0.640 Terabits per second, N=256 embodiment mentioned previously and shown in FIGs. 4 and 5, the 
controller 20 may be contained on approximately eight printed circuit boards. Controller 20 would accept up to 256 
sixteen-bit request vectors from up to 256 line input interfaces 1 2 0 -1 2 255 and perform path hunts on each of these request 
vectors within each 1 76 nanosecond. ATM cell interval to create the 1024 sixteen-bit connect vectors used to established 
connections within the switch fabric 14A. This requires that controller 20 operate with a processor clock rate of at least 
46 Mbps. This moderate clock rate permits the logic within the controller 20 to be implemented with off-the-shelf CMOS 
EPLD's or similar devices, thus making the cost of the controller 20 (in large quantities) very reasonable. 

The movement of request vectors from the input interfaces 12 0 -12 25 5 to the controller 20 and the movement of 
connect vectors from the controller 20 to the crossbar switches 15 0 -15 S3 of the switch fabric 14A is a challenging task, 
because large amounts of control information must be transported every 1 76 nano seconds ATM cell interval. For exam- 
ple, in an ATM switch containing 256 input interfaces, 256 16-bit request vectors must be transported to the controller 
20 every 1 76 nano seconds, leading to an aggregate bandwidth of 23 Gigabits per second between the input interfaces 
sub-system and the controller 20 sub-system. In addition, 1024 1 6-bit connect vectors must be transported to the switch 
fabric 14A every 176 nano seconds to control the crossbars switches 15 0 -15 63 . This requires an aggregate bandwidth 
of 93 Gigabits per second between the controller 20 sub-system and the switch fabric 1 4A sub-system. This 93 Gigabits 
per second connect vector information can be compressed into 29 Gigabits per second (given that only one input can 
be routed to an output during each ATM cell interval) by standard compression techniques. However, since this control 
information should be delivered with high reliability, all of the control connections or control links between these sub- 
systems should be dually redundant (not shown in FIG 4), so there is actually 46 Gigabits per second of data moving 
between the input interfaces cards and the controller 20 and 58 Gigabits per second of data moving between the controller 
20 and the switch fabric 14A. Preferably, high-speed serial links 22 will be used to transmit this control information. For 
such a case, input interfaces 1 2 0 -1 2 255 would be grouped by fours such that only sixty-four serial li nks would be required 
to move request vectors from the input interfaces 12 0 -12 2 55 to the controller 20, and 128 serial links would be required 
to move the resulting connect vectors from the controller 20 to the pipes 18 0 -18 3 (assuming the aforementioned data 
compression techniques are applied to the connect vectors). 

While the use of out-of-band control techniques does require the additional hardware cost of these high-speed serial 
control links 22, these links 22 cause very little increase the overall system hardware cost. Considering that the 256- 
input ATM switch 10A of FIGs. 4 and 5 already has 1024 high-speed serial links required to route ATM cells between 
the input interfaces 120 0 -12 255 , and the switch fabric 14A (when the fanout of four is included) and 1024 more high- 
speed serial links are used to route ATM cells from the switch fabric outputs 19 0 -19 10 23 to the output packet modules 
16o-16 15 . Thus, the addition of the 192 serial links 22 for routing of the control information increases the total number 
of high-speed serial links within the system by merely nine percent. 

Applying the calculations of Yeh et al. from the article "The Knockout Switch" the ATM cell loss probability of the 
ATM switch 1 0A shown in FIGs. 4 and 5 is 4.34x1 0" 3 , assuming that the connections of the inputs are symmetrical and 
not independent as will be described later in this application. This cell loss probability falls short of the acceptable ATM 
cell loss probability of less than 1x10 12 mentioned previously. 

To reduce the ATM cell loss probabilities, controller 20 applies a temporal spreading technique known as rolling, 
which provides many statistical advantages. Rolling involves and fulfills three fundamental goals that are aimed at pro- 
viding more evenly distributed traffic loads. These goals are: (1) spatially distribute the traffic evenly across all pipes 
1 8q-1 8 3 so that one pipe will only carry its proportional fraction of the traffic load, (2) spatially distribute the traffic evenly 
across all of the 16x16 crossbar switches 15 0 -15 63 within each pipe 18 0 -18 3 so that each of the crossbar switches is 
equally loaded, and (3) temporally distribute the traffic that arrives in a given ATM cell period across two ATM cell periods 
so that the traffic load can be effectively decreased in an occasional ATM cell period when an unusually high volume of 
traffic exists and is destined for a particular output packet module. This effective lowering of the traffic load is accom- 
plished by delaying some of the ATM cells arriving during a congested ATM cell interval. The cells are delayed until the 
next consecutive ATM cell interval when the traffic load competing for the popular resources, i.e. connections to popular 
output packet modules, will most likely be lower, so the delayed cells should have a higher probability of being routed 
in the next ATM cell interval. Since the switch fabric 14A is memoryless, the ATM cells that must wait for the next ATM 
cell interval are stored in their respective input interfaces 12 0 -12 255 . 

In addition to satisfying these three fundamental goals of packet traffic control to distribute the load, rolling also 
satisfies two further very important ATM system goals. First, goal (4) is that the ATM switch 10A must guarantee that 
ATM cell ordering can be simply maintained when an ATM stream is re-constructed at an output packet module 16 0 - 
1 61 5 even if rolling causes some of the ATM cells within the stream to be delayed differently than others. Secondly, goal 
(5) is that rolling must also guarantee that the controller 20 will attempt to route every ATM cell through each of the four 
paths to its desired output packet module, but each of the successive path hunt attempts must occur in a more lightly- 
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loaded 16x16 crossbar switch so that the first attempt occurs in a 16x16 crossbar switch with many previously-routed 
ATM cells (and very few available paths to output packet modules) while the fourth and final path hunt attempt occurs 
in an 16x16 crossbar switch that is virtually empty (thereby providing many available paths to output packet modules). 
The rolling technique is similar to spatial path hunt techniques that pack as many calls as possible in one portion of a 

s spatial network, which by forcing near 100% occupancy in parts of a system results in the remainder of the calls having 
a very high probability of being successfully routed through the remainder of the system if usage is below 100%. Thus, 
rolling in its fourth and final path hunt attempt provides a very high probability of an ATM cell successfully being routed. 
Goal (5), by packing many ATM cells in one portion of the network, superficially seems to conflict with goal (1) that 
requires the traffic be spatially distributed across the network. However, as will be explained below, temporal spreading 

io provided by the rolling technique permits the network to simultaneously satisfy both goals (1) and (5). 

Assuming that each of the 256 input ports 1 7 0 -1 7 N .-| of FIG. 4 has an ATM cell that needs to be routed through the 
distribution network, and assuming that the switch fabric 14A is composed of four pipes 18o-18 3 , then the out-of-band 
controller 20 may be required to perform 256x4=1024 unique path hunts for the ATM cells before the cells can be routed. 
To distribute the ATM cells evenly across all four pipes, the 256 ATM cells requesting connections, the rolling technique 

75 divides the requests into four groups of equal size. The first group will have path hunts performed for its ATM cells in 
pipe 1 8 0 first, then in pipe 18^ then in pipe 182, and finally in pipe 18 3 . The second group will have path hunts performed 
for its ATM cells in pipe 1 81 first, then in pipe 1 8 2 , then in pipe 1 83, and finally in pipe 1 8 0 . The third group will have path 
hunts performed for its ATM cells in pipe 1&2 first, then in pipe 18 3 , then in pipe 18 0 , and finally in pipe 18^ The fourth 
group will have path hunts performed for its ATM cells in pipe 183 first, then in pipe 18 0 , then in pipe 18 1f and finally in 

20 pipe 1 83. This ring-like ordering of the path hunts guarantees that the routed ATM cells are distributed evenly across all 
four pipes. In addition, if the ATM cells within each of the four equally sized groups are selected such that the ATM cells 
within a single group can be routed into exactly four of the 16 inputs on any 16x16 crossbar switch, then the routed ATM 
cells will also be evenly distributed across all of the 16x16 crossbar switches. 

Referring now to FIGs. 5 and 6, a timing diagram for a rolling technique according to the present invention is 

25 described. To satisfy goals (1), (2), and (5) simultaneously, the out-of-band controller 20 uses the time delay/time dis- 
tribution described in goal (3), and these ATM cell delays required by goal (3) must be provided during each ATM cell 
interval. In all cases, when a group of ATM cells is passed around the ring-like structure of controller 20 from pipe 18 3 
to pipe 18o, the controller 20 re-assigns the cells to the next ATM cell interval (period) which requires that the ATM cells 
be delayed by one cell period. Because of this re-assignment and delay, each cell group encounters a very lightly-loaded 

30 set of 1 6x1 6 crossbar switches for its fourth and final path hunt. An additional advantage of this rolling technique using 
re-assignment and delay of ATM cell intervals is that it also allows more than 64 simultaneously arriving ATM cells to be 
routed through the switch fabric 14A to any single output packet module 16 0 -16 15 (even though there are only 64 con- 
nections or links from the switch fabric 1 4A to each output packet module 1 6q- 1 6 1 5 ) . This occurs with the rolling technique 
because all of the ATM cells do not need to be routed during the same ATM cell interval. Thus, the rolling technique 

35 when used in the out-of-band controller 20 results in extremely low cell loss probabilities both within the switch fabric 
14A and the output modules 16o-16 15 , even during a transient cell interval that has an extraordinarily high traffic load. 

The one ATM cell period delays incurred by some of the ATM cells as they are routed through the switch fabric 1 4A 
would normally lead to the conclusion that there would be difficulties in satisfying goal(4) of maintaining proper cell 
ordering. However, the ring-like ordering of the path hunts within the out-of-band controller 20 guarantees that delayed 

40 cells in a stream of ATM cells will always be routed through lower-numbered pipes than non-delayed cells (where pipe 
18 0 is the lowest-numbered pipe and pipe 183 is the highest-numbered pipe). This information, coupled with the fact 
that ATM cells are delayed by at most one cell period, ensures that proper cell ordering will be maintained if the cells 
are extracted from the switch fabric 14A and loaded into first-in-first-out queues 174 0 -1 74 63 (shown in FIG. 7) of each 
output module of the output modules 16o-16 15 in the order of the lowest numbered pipe to the highest numbered pipe: 

45 pipe 18 0 , pipe 18^ pipe 18 2 , and pipe 18 3 . 

Referring now to FIG. 7, the output module 16 0 (and the fifteen other output modules I61-I615) may be a 64x16 
embodiment of the concentrator described in U.S. Patent No. 5,412,646, entitled "ASYNCHRONOUS TRANSFER 
MODE SWITCH ARCHITECTURE", issued May 2, 1995, by Cyr et al. and commonly assigned to the assignee of the 
present invention. This U.S. patent is hereby incorporated by reference. The output module 16 0 in FIG. 7 is a specific 

50 case of the generalized concentrator shown in FIG. 4 of the above-referenced patent of Cyr et al. Since the output 
modules 1 6 0 -1 6 1 5 are well described in the above referenced application, in the interest of brevity they will not be further 
described here. 

To provide a better understanding the equation of the rolling technique, a real-life analogy will be described with 
respect to FIG. 8, which is a plan view of an amusement park system 500. Consider the problem of transporting a large 
55 number of people from amusement park parking lots 51 1 , 512, 513, or 514 to the amusement park 520 using trams to 
shuttle the people between the two points. Tram system 530 is composed of four tram shuttle trains each with a prede- 
termined route, which is analogous to the four pipes of switch fabric 14A. Each tram shuttle train contains sixteen cars 
(representing the 1 6x1 6 crossbar switches within a particular pipe), and each shuttle car is equipped with sixteen seats 
(representing the output links emanating from a single 16x16 crossbar switch). In this analogy, each customer (repre- 
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senting an ATM cell) arrives in one of four parking lots 51 1. 512, 513. or 514 surrounding the amusement park 520. As 
a result, each customer is instantly placed in one of four groups, and since the parking lots 51 1 -514 are the same size, 
each group contains an equal number of customers on the average. The customers in any single parking lot 511,51 2, 
513, or 514 must then divide up and stand in one of sixteen lines, where each line is associated with a respective car 
of the tram shuttle train. The amusement park 520 is sub-divided into sixteen different theme areas (The Past Land, The 
Future Land, etc.), and each of the sixteen seats of a particular tram car is labeled with the theme area to which that 
seat's occupant will be given admission. Before arriving in the parking lot, each customer must randomly chose one of 
the sixteen theme areas (representing the sixteen output packet modules 16 0 -16 15 ) where he or she wishes to spend 
the day. Customers must then find an available seat associated with their desired theme area on one of the four trams 
that passes by the loading area 531 , 532, 533, or 534 of their parking lot. If a customer has not found an available seat 
after four trams have passed by, then he or she is not permitted to enter the amusement park during that day (This harsh 
condition represents the loss of an ATM cell due to blocking in all four pipes of the distribution network, a small but finite 
possibility). 

The first tram that stops at the loading area that the customer can try has already visited three other parking lot 
loading areas, so the customer's pre-specif ied seat may be full. However, if the customer does find his or her seat to be 
vacant on that tram, then the tram will deliver him or her straight to the amusement park 520. If the customer fails to get 
on the first tram, he or she must wait and try the second tram which has already visited two other parking lot loading 
areas. If the customer is successful at finding his or her pre-specif ied seat on the second tram, that tram will deliver the 
customer to the amusement park 520 after one more parking lot stop. If the customer fails to get on the first tram and 
the second tram, then he or she must wait and try the third tram which has only visited one other parking lot loading 
area. If the customer is successful at finding his or her seat on the third tram, that tram will deliver him or her to the 
amusement park 520 after two additional parking lot stops. If the customer fails to get on any of the first three trams, 
then the customer must wait and try the fourth and final tram. Fortunately, this tram has not visited any parking lots yet, 
so the arriving tram is empty, and the customer's seat will be taken only if another customer in his/her parking lot line is 
also trying for the same seat. The system 530 satisfies goal (5), because each of the successively arriving trams is more 
lightly-loaded than the previous one. Thus, a controller 20 rolling ATM cells indeed can fulfill goals (1), (2), and (5). 

The rolling technique if used by itself improves the ATM cell loss probability of ATM switch 10A from 4.34x1 0" 3 to 
approximately 1 0* 1 1 . Using the analysis techniques of the article "A Growable Packet Switch Architecture" the cell loss 
probabilities for an ATM switch 1 0A that has independent connections to inputs of the switch fabric 1 4 according to Galois 
field theory and also has an out-of-band controller 20 that incorporates rolling techniques can be analytically modeled 
and calculated. Each of the 1 6x1 6 crossbar switches in pipe 1 8 0 receives an offered traffic load equal to Ra=R L /4+Rres , 
where Rres is defined to be the fraction of the 16 inputs to a 16x16 crossbar switch that are blocked in pipe 18 3 and 
routed to pipe 18 0 for a re-attempt. For a first attempt at solving for the cell loss probability, let us assume that 
Rres=R L /16 . Thus, the cell loss probability of a single 16x16 crossbar switch in pipe 18 0 can be determined using the 
equation of Eng et al. 



P(cell loss)=[1 -m/(nR L )] [1 - £ {{nR L ) k e{-nR L )}/kWnR L ) V""" J /m! ; 



where m=1 , n=1 , and the switch loading is given by Ra=R L /4+R L /16 . Using these assignments, the resulting cell loss 
probability for a fully-loaded (R L =1.0) pipe 18 0 16x16 crossbar switch can be calculated to be: 

P(cell loss in pipe 18 0 )=1.3x10" 1 . 

Thus, the fraction of the 16 inputs to a 1 6x1 6 crossbar that are passed to the second pipe after the first attenpt is given by: 

f 1 -2=Ra x P(cell loss in pipe 1 8 0 ) = (3. 1 3x1 0 1 )(1 .3x1 0 1 ) = 4.06x1 0 ' 2 . 

By symmetry, this should have also been the same as the fraction of inputs that are passed from pipe 1 8 3 to pipe 
18q, so the residue assumption of R L /1 6=0.062 above was incorrect. By refining this assumption and performing a 
second attempt, and now assuming that Rres=R L /32 . Thus, the cell loss probability of a single 1 6x1 6 crossbar switch 
in pipe 18 0 can be determined again using the equation of Eng et al., where m=1 , n=1. and the switch loading is given 
by Ra=R L /4+R L /32 Using these assignments, the resulting cell loss probability for a fully-loaded (R L =1-0) pipe 18o 
16x16 crossbar switch is calculated to be: 



P(cell loss in pipe 18 0 )=1.2x10" 1 . 
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Thus, the traction of the 1 6 inputs to a 1 6x1 6 crossbar that are passed to the second pipe after the first attempt is given by: 
f1-2 =Rax P(cell loss in pipe 18 0 ) = (2.81x1 0" 1 )(1 .2x10 1 ) = 3.37x10'*. 

This calculation result is very close to the assumed value of Rres=R L /32=3. 1 3x1 0 " 2 , so the assumption is consid- 
ered to be satisfactory. The blocked cells are sent to pipe 1 8^ for subsequent path hunting, and they encounter a negligible 
number of ATM cells from previous attempts. Thus, the 1 6x1 6 crossbar switch in pipe 1 8! can be modeled for analysis 
as a growable packet switch, with m=1 , n=1 , and Ra = f 1 -2 , and the resulting cell loss probability of this model is 1 .4x10" 
21 . The fraction of the 16 inputs to the 16x16 crossbar in pipe 18! that are passed to the pipe 18 2 is 4.2x1 0" 4 . Similar 
arguments can be used to show that the resulting cell loss probability for cells entering pipe 18 2 is 1.9x10" 4 , and the 
resulting fraction of the 16 inputs to a 16x16 crossbar passed to pipe 183 is 7.9x1 0" 8 . The resulting ATM cell loss prob- 
ability in pipe 183 is 3.7x10 8 . and the fraction of the 16 inputs to a 16x16 crossbar not routed in pipe 183 (and therefore 
not routed in all tour pipe attempts) is 2.9x10" 15 . Thus, through the use of the rolling techniques within the out-of-band 
controller 20. the ATM cell toss probability of an ATM switch 1 0A with independent connections at the inputs of its switch 
fabric 14A can be decreased from an unacceptable value of 1.47x10" 6 to an acceptable value of 2.9x10" 15 . 

A preference techruque may be used in conjunction with the rolling technique described above to decrease the cell 
loss probability of an ATM switch 10A even further. Referring back to FIG. 8 and the amusement park analogy, some 
form of arbitration was lequved at the tram loading areas to determine which of the customers in the line will be given 
a particular seat on the tram when more than one customer is requesting the same seat. Similarly, the out-of-band 
controller 20 must provcJe an artxtrabon scheme for selecting which of the arriving ATM cells will be assigned a particular 
link whenever two or mora cells request access to the same link. The arbitration scheme used can have an advantageous 
effect on the ATM eel loss probabdrties. 

One possble arbrtraftsn scheme is a random scheme to determine which of the ATM cells is assigned the link. The 
random selection scheme & the scheme assumed for the analysis of the rolling technique presented above. However, 
other arbitration schemes are posstde and one particular arbitration scheme that has advantageous results is called 
the preference scheme The preference arbitration scheme assigns a preference weight to each of the ATM cells in a 
particular grouping. ATM ceils with tagher preference weights are given precedence over ATM cells with lower preference 
weights whenever two or more cefls request access to the same link. As a result, an effective hierarchy is created within 
the groupings of ATM ce<s 

The creation of a hierarchy may superficially seem to produce undesirable characteristics within the switch fabric 
1 4A, because customer* with r*gh preference weights will be offered better service than customers with low preference 
weights. In fact, the one customer with the highest preference weight within each group can never have his or her ATM 
cell blocked by another customer s ATM cell. Although this may seem unfair, a detailed analysis of the effects of imposing 
this hierarchy indicates that rt actually leads to improved performance, i.e. lower cell loss probabilities, for all customers- 
even for the customer at the bottom of the hierarchy with the very lowest preference weight. 

The results of this analysis are summarized in FIG. 9, where the probability of loss of an ATM cell ; i.e. , the probability 
of a cell not being assigned to an available path, is shown as a function of the number of path hunts that were attempted 
in different pipes by the out-of-band controller 20. In this analysis, it was assumed that the group sizes were four- i.e., 
up to four ATM cells could sjmurtaneously compete for access to the same link. As a result, four different preference 
weights were assigned to create a hierarchy for the four input ports associated with each group. The preference weight 
associated with a particular input port is assumed to be a fixed constant that does not vary with time. The resulting plots 
901 , 902, 903 and 904 n FK3 9 indicate that the cell loss probability decreases as more path hunts in more pipes are 
performed, but it also show* that the inputs with the lower preference weights 903, 904 have higher cell loss probabilities 
than the inputs with higher pi eterence weights 901 , 902, as might be expected. Super-imposed on these plots is a similar 
plot 91 0 which indicates the pr obabtkty of not being served when a random selection arbitration scheme is used instead 
of the hierarchy arbitration scheme The surprising and unexpected results are that after path hunt attempts in four 
different pipes, the random seiectnn arbitration scheme produces cell loss probabilities which are higher than the average 
of the cell loss probabilities tor the hierarchy arbitration scheme. In fact, the plot 91 0 of the random selection arbitration 
scheme shows an average cefl loss probabilities for all of the input ports which are notably higher than the plots 903 
and 904 which are the average cell loss probabilities for even the input ports with the lowest preference weights within 
the hierarchy arbitration scheme This phenomenon can be explained by the fact that after three sets of path hunts in 
three different pipes, the rjstrfcuhon of ATM cell requests entering the fourth pipe is very different depending on whether 
the random or preferences arbitration scheme is used. In the random selection arbitration scheme, there is a small but 
equal probability that all of the ATM cells are requesting a path. However, in the hierarchy arbitration scheme, most of 
the ATM cells with higher preference weights will be requesting a path with a probability of practically zero, while the 
ATM cell with the lowest preference weight will be requesting a path with a sizable probability, because that particular 
ATM cell may have been denied access to links in all three of its previous path hunt attempts. However, a single request 
arriving with a high probability at the fourth and last path hunter in the controller will lead to more routed ATM cells than 
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many requests arriving with low probability, because the single request can always be satisfied since contention for an 
output link will never occur. 

As a result, it seems apparent from the plots in FIG. 9 that by assigning preference weights to the input ports and 
by using a hierarchy arbitration method to resolve link contention and route paths in the out-of-band controller, the worst- 
case cell loss probability of the switch fabric 1 4A can be decreased from 2.9x10' 15 that was achieved by the introduction 
of the rolling technique to an even lower value of 2.4x10" 16 . It is worth noting that input ports that are assigned higher 
preference weights will encounter even lower cell loss probabilities as indicated in FIG. 9. 

Referring back to FIG. 5, in order to provide a physical embodiment of the rolling and preference methods, the ATM 
switch 10A is segmented in to four basic sub-systems. These four sub-groups consist of the input interfaces 12 0 -12 25 5, 
the output modules 16 0 -16 15 , the switch fabric 14A, and the out-of-band controller 20. 

The input interfaces 1 2 0 - 1 2 255 within the network provide the necessary interfaces between the incoming transmis- 
sion links and the links connected to the switch fabric 14A and the out-of-band controller 20. As a result, the input 
interfaces 12 0 -12 255 must provide a termination for the input transmission line. For example, if the input transmission 
line is a SONET link, then the input interface must provide for clock recovery, link error detection, SONET pointer process- 
ing and frame delineation, ATM cell extraction, and an elastic storage function to synchronize the arriving ATM cells to 
the system clock within the distribution network. The extracted ATM cells are then loaded into a FIFO buffer of the input 
interface. The input interface must also read ATM cells from the FIFO buffer and extract the ATM header from the cell. 
The VPIA/CI field of each ATM header is then used as an address into a translation table located on the input interface. 
The output of the translation table provides a new VPIA/CI field and the address of the output packet module to which 
the ATM cell is to be routed. The new VPIA/CI field is written into the ATM cell as a replacement for the old VPIA/CI field, 
while the output module address is routed as a request vector to the out-of-band controller 20 for the controller fabric 
14A. Since the amount of processing time required by the out-of-band controller 20 is a fixed value, the input interface 
simply holds the ATM cell in a buffer until the out-of-band controller 20 has completed its path hunt and has relayed the 
results into the switch fabric 14A. Once the switch fabric 14A is loaded with the new switch settings to appropriately 
route the ATM cell, the input interface can inject the ATM cell into the switch fabric 14A and it will be automatically routed 
through the switch fabric 14A to its desired output module 16 0 -16 15 . It should be noted that each input interface 12 0 - 
12 255 actually is provided with one link to each of the four pipes 18o-18 3 of the switch fabric 14A. In addition, the use of 
rolling (i.e. temporal spreading) within the switch fabric 14A may require a copy of the ATM cell to be injected into each 
of the four links during any one of two consecutive ATM cell intervals. As a result, the timing within the input interfaces 
1 2 0 -1 2 255 must be tightly coupled and synchronized to the timing of the rest of the sub-systems withi n the ATM switch 1 0A. 

Each of the two hundred fifty six input interfaces 1 2 0 -12 25 5 in FIG. 5 are numbered with an address ranging from 0 
to 255, but each input interface is also assigned an alias address given by a letter between A and P. These alias addresses 
are used to identify which input port the input interfaces will connect to within the switch fabric 14A. The actual set of 
four crossbar switches to which a particular input interface is connected is determined by Galois field techniques. These 
techniques guarantee independence between all of the inputs on any 16x16 crossbar switch of any pipe. 

Each of the sixteen output modules 16 0 -16 15 in FIG. 5 is labeled with addresses ranging from AA to PP, and each 
output module performs an important function within the ATM switch 10A. Each of the output modules 16 0 -16 15 within 
FIG. 5 provides terminations for a respective set of sixty-four links emanating from the switch fabric 14A. Each output 
module 16 0 -16 15 also provides two basic functions: it provides a small degree of space switching to route each ATM cell 
arriving on one of the sixty-four inputs to the desired one of the sixteen output ports, and it provides buffering of ATM 
cells to handle the problems associated with multiple packets that are simultaneously destined for the same output Out 0 - 
Out 255 . 

There are many ways for these two functions to be implemented. The most straight-forward approach would probably 
construct a shared memory switch that could perform sixty-four memory writes and sixteen memory reads within an 
ATM cell interval (176 nano seconds). The memory could then be treated as sixteen disjoint linked lists (one for each 
output Out 0 -Out 255 ) along with a seventeenth linked list containing idle memory locations. Although simple, this approach 
requires eighty memory accesses every 1 76 nano seconds, so it would demand memories with 2.2 nano seconds access 
times. An alternate approach would split each 64x16 output module 16o-16 15 into a 64x16 concentrator and a 16x16 
shared memory switch. The concentrator would be a memory system that provides for sixty-four writes and sixteen reads 
every ATM cell interval, but the memory size could be small (and memory speeds could be fast) since the buffering 
required for output contention problems is not provided in this memory. In addition, the 64x16 concentrator could be 
implemented as a single linked list spread out across sixty-four distinct memory chips. As a result, each memory chip 
would require only one write and up to sixteen reads for every ATM cell interval. The 1 6x1 6 shared memory switch only 
performs thirty-two memory accesses every ATM cell interval, so slower (and larger) memories could be used, and the 
buffering for output contention problems could be provided in this shared memory portion of the output module. Thus, 
this latter arrangement is the more practical alternative for an output module. 

The switch fabric 14A is essentially a group of small circuit switches that provide the required connectivity between 
the input interfaces and the output modules in response to the control signals generated by the out-of-band controller 
20. In the embodiment of the ATM switch 10A shown in FIG. 5, the switch fabric 14A is composed of sixty-four 16x16 
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crossbar switches, where disjoint groups of sixteen switches comprise a pipe. The four pipes are labeled pipe 18 0 , pipe 
18i. pipe 182, and pipe 18 3 , and the sixteen 16x16 crossbar switches within a given pipe are labeled switch 0-15. The 
crossbar switches must be capable of receiving the control signals generated by the out-of-band controller 20 and must 
re configure all of the switch settings during a guard-band interval between consecutive ATM cells. Each 1 6x1 6 crossbar 

5 switch supports sixteen inputs labeled input A through input P, and each 16x16 crossbar switch also supports sixteen 
outputs labeled output AA to output PP. It was noted above that each input interface connects to a different 16x16 
crossbar in each of the four pipes 180-183, but it should now be noted that an input interface that connects to input X in 
pipe 18 0 is required to be connected to input X in the other three pipes 18 r 183 as well, where X is an element of the 
set {A.B P}. The actual connections between the input interfaces 1 2 D -1 2 255 and the crossbar switches within the switch 

10 fabric 1 4A are determined using Galois field theory techniques that were referenced above. These techniques guarantee 
independence between input ports for routing within switches in each pipe of the switch fabric 1 4A. FIG. 5 also illustrates 
that output YY from each of the sixty-four crossbar switches is routed to one of the sixty-four inputs on the 64x1 6 output 
module labeled YY, where YY is an element of the set {AA,BB,..,PP}. 

The basic function of the out-of-band controller 20 for the switch fabric 1 4A is to determine through which of the four 

15 pipes 18 0 -18 3 a particular ATM cell may be routed. Once the out-of-band controller 20 has successfully determined a 
pipe through which the ATM cell is to be routed without being blocked, the task of setting up the path through the pipe 
is simple, because by the definition of a pipe, there will exist only one path within the pipe between the input port of the 
arriving ATM cell and the desired output module. As a result, the fundamental path hunting task of a switching network 
is essentially reduced to the simpler task of pipe hunting in the ATM switch 10A. 

20 The out-of-band controller 20 still requires a large busy-idle table to identify the status of each of the intermediate 
(FN) links between the 16x16 crossbar switches of the switch fabric 14A and the output modules 16 0 -16 15 as busy and 
unavailable or idle and available. However, this large busy-idle table may be sub-divided into many small busy-idle tables 
that the controller 20 can access in parallel, and thereby perform many pipe hunting operations in parallel. There are 
many ways to implement the controller 20 for a large switch having the general growable packet switch architecture. In 

25 the extreme case, four levels of parallelism may be applied to the architecture of the controller 20 to perform pipe hunting. 
One embodiment that uses three levels of parallelism will be described in detail, first and then a fourth level of parallelism 
for the controller 20 will be discussed. 

The first level of parallelism is obtained by providing each of the four pipes 180-183 with a respective pipe hunt 
controller 24 0 -24 3 . This level of parallelism allows pipe hunting to be carried out in all four pipe hunt controllers 24 0 -243 

30 simultaneously. The second level of parallelism is obtained by providing switch controllers 26 0 -2663, with sixteen switch 
controllers within each pipe hunt controller 24 0 -24 3 . A unique switch controller 26 0 -26 63 is respectively associated with 
each of the 16x16 switches within each pipe of the switch fabric 14A. As a result, pipe hunting operations can be carried 
out in parallel within all sixteen of the switch controllers of each pipe hunt controller 24 0 -24 3 . The third level of parallelism 
is obtained by permitting each of the switch controllers 26 0 -26 63 to perform parallel processing over all sixteen of the 

35 output links attached to its respective 16x16 crossbar switch. Effectively, each of the switch controllers 26 0 -26 63 reads 
sixteen busy-idle bits from its busy-idle memory in parallel, performs parallel pipe hunting operations based on those 
sixteen bits, and then writes the sixteen resulting busy-idle bits into its respective busy-idle memory in parallel with the 
other busy-idle memories. A representative switch controller 26 0 of the sixty four switch controllers 26 0 -26 63 is shown 
in FIG. 10. The concurrent processing of sixteen busy-idle bits is accomplished by providing switch controller 26 0 sixteen 

40 unique link controllers AA-PP, each of the link controllers AA-PP is assigned the task of processing busy-idle bits for 
one intermediate link between its portion of the switch fabric 14A and its respective output modules. In the embodiment 
shown in FIG. 10, the large busy-idle memory required to control switch 10A has been divided into many single bit 
memories, busy-idle flip-flops, with each single bit, busy-idle memory being logically and physically associated with its 
respective link controller AA-PP. 

45 The general data flow for request vectors generated by the input interfaces 1 2q-1 2 2 ss is shown in Fig. 5. For example, 
input interface 1 2q in Fig. 5 routes its request vector to pipe hunting controller 24 0 where it is poked into the pipe hunting 
ring (i.e. controller 20), and the rolling scheme requires the request vector to be looped through pipe hunt controller 24^ , 
pipe hunt controller 24 2 , and pipe hunt controller 24 3 as it circulates around the ring. In general, each of the input 
interfaces 12 0 -12 25 5 produces one request vector, and each request vector will contain a number of bits equal to the 

50 number of output modules within the system. The request vector from a single input interface in FIG. 5 is thus a sixteen- 
bit data word, where each bit of the request vector points to one of the sixteen output modules. If an ATM cell within a 
input interface is requesting a connection to an output port on the i-th output module, then bit i within the request vector 
will be set to a logic "1" and all other bits within the request vector will be set to a logic "0". When the controller 20 
receives this particular request vector from the input interface, it can then identify that a path is required between the 

55 source input interface and the i-th output module. 

The entire sixteen-bit request vector from a input interface is routed via a respective control connection 21 0 -21 2 55 
to one of the four pipe hunt controllers 24 0 -24 3 , and the controller 20 pokes the vector into one of the sixteen switch 
controllers associated with that particular pipe hunt controller. As shown in FIG. 1 0, the sixteen bits of the request vector 
are injected into a switch controller and are distributed across all sixteen of the link controllers within that particular 
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switch controller. Each link controller is associated with a single link between the crossbar switches and the output 
modules, and it essentially processes one bit of the sixteen-bit request vector. This finite state machine circuitry that is 
associated with a single link controller consists of one flip-flop (the single-bit memory required to store the busy-idle bit 
associated with this link controller's link) and four logic gates. A state table description of the link controller operation is 
given in FIG 12. where the state variable is defined by the busy-idle bit. The link controller hardware provides for one 
request vector input bit. designated request-in; one request vector output bit, designated request-out; and one connection 
vector output bit. designated connect. The request vector input bit is a logic "1 " if the input desires a connection through 
the link associated with this link controller-otherwise, it is a logic "0". The request vector output bit is a logic "1" if the 
logic " 1" input request vector bit was not satisfied by this particular link controller-otherwise, it is a logic "0". The connect 
vector output bit is a logic "1" if the logic "1 " input request vector bit was satisfied by this particular link controller indicating 
the ATM cell will be routed to its desired output module through the link associated with this link controller- otherwise, it 
is a logic "0". The busy-die flip-flop in Fig. 10 is reset to the logic "0" (idle) state at the beginning of each ATM cell slot, 
so the first request vector bit that enters the link controller with a logic "1 " request is assigned the link (creating a logic 
"1" connect vector bit and a togic "0" output request vector bit) and sets the busy-idle flip-flop to the logic "1 " (busy) state. 
Any subsequent request vector bits that enter the link controller during this particular ATM cell slot will be denied a 
connection through the link (torcing a logic "0" output on the connect vector bit and creating an output request vector 
bit that is identical to the input request vector bit). A time-lapsed view of several consecutive sixteen-bit request vectors 
passing through a sing* switch controller is shown in Fig. 1 2, along with the resulting states of the busy-idle bits stored 
within the switch controfler The resulting output request vectors and output connect vectors illustrate the general oper- 
ation of each of the pp* hunt cor* oilers 24o-24 3 . 

The use of rolling withn the controller 20 requires a very precise temporal ordering of two fundamental events: 
poking and busy-idle fbp-rhp cfatwq The timing diagram of FIG. 13 illustrates the synchronization and data flow that 
might be used for the log* within the controller 20. As indicated by the timing diagram, the flow of data around the ring 
of controller 20 is from ppe controller 24q to pipe controller 24! to pipe controller 24s to pipe controller 24 3 and back to 
pipe controller 24 0 Request vectors generated by input interfaces with alias addresses A, B, C, and D are poked into 
pipe controller 24 0 . Request vectors generated by input interfaces with alias addresses E, F, G, and H are poked into 
pipe controller 24, Request vectors generated by input interfaces with alias addresses I, J, K, and L are poked into pipe 
controller 24 2 . Request vectors generated by input interfaces with alias addresses M, N, O, and P are poked into pipe 
controller 243. The poking tmes and busy-idle bit clearing times take place at different moments within each of the pipe 
hunt controllers 24 0 -24 : . From the point of view of any pipe controller, the request vector bits flow through the pipe 
controller in alphabetical order (A to P) if one ignores the busy-idle bit clearing times. This ordering guarantees that the 
aforementioned advantages 0* preferences will be realized within the controller 20, because the request vector generated 
from a input interface with ahas address A will always be given precedence over the request vectors generated from 
input interfaces with alias addresses B. C, and D, etc. 

The benefits derived from torced independence between the inputs on a particular 1 6x1 6 crossbar switch produce 
a slight increase in the complexity of the pipe hunter circuitry. Because of the independent connections between the 
input interfaces and the switch tatonc 14A. which independence is assured by the use of Galois field theory, a request 
vector from a single input interlace must be appropriately routed to several different switch controllers in each of the 
stages in the pipe hunting nog The mixing nature of the Galois field theory generated connections requires each input 
interface 1 2 0 -1 2 255 to be connected to a different set of 1 6x1 6 crossbar switches within the switch fabric 1 4A, and as a 
consequence, it also requires request vectors generated on different input interfaces to be routed through entirely dif- 
ferent sets of switch controllers within the controller 20. Since request vectors are time-multiplexed on links within the 
controller 20, all of the request vectors (within a particular ATM cell slot) that are expelled from a particular switch controller 
in one pipe hunter stage must (by definition) be routed to different switch controllers in the next pipe hunter stage. To 
provide this dynamic routing o» the request vectors, each pipe hunt controller 24 0 , 24,,24 2 and 24 3 is connected to a 
respective small switching network 30o. 30,. 30 2 and 30 3 , shown in FIG. 5. Alternatively, simple multiplexers may be 
used instead of switching networks 30o. 30, . 30 2 and 30 3 , thereby greatly decreasing costs for the controller 20. Fortu- 
nately, the required configurations of these small switching networks 30 0 , 30,, 30 2 and 30 3 ,(or multiplexers) are cyclic 
with a period equal to the ATM cei period, and the required configurations can be determined a priori and can therefore 
be "hard-coded" into the small switching networks (multiplexers) during the design of the circuitry of the controller 20. 

As mentioned previously. ATM switch 1 0A shown in FIG. 5 might be scaled such that the number of input lines were 
512, 1024 or even higher For those size switches, assuming that the input lines are carrying 2.5 Gigabits per second 
data rates, the aggregate throughput would be over 1 .0 Terabits per second. For switches of that size, a fourth level of 
parallelism may be needed to prcvrie sufficient processing power for the controller 20 to hunt for all the paths through 
all the pipes in real time. For ATM switches with 512 and 1024 input lines, the data rates on connections within their 
respective controllers are 204 Mbps and 386 Mbps, which is considerably higher that the 1 1 3 Mbps rate of the 256 input 
line version of ATM switch 10A. 

The basic idea behind the fourth level of parallelism is a modification of the previously described controller 20 design 
which requires that request vectors be routed through the pipe hunter stages in parallel. In particular, all of the request 
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inefficiencies may ultimately lead to the desire for a new cell length standard. Thus, it is desirable to have an ATM switch 
architecture that can adapt to changes in cell or packet length. 

With only a few minor modifications to the input interfaces 12 0 -12 255 and the controller 20, operation of ATM switch 
10A with cells of arbitrary cell lengths is provided. This is accomplished by allowing arbitrary length that are an integer 
multiple of the basic cell period, which can be 53 bytes or some other desired length. The ATM switch 10A may be 
modified so readily to support arbitrary cell lengths primarily because ATM switch 1 0A is essentially a circuit switch, i.e. 
an arbitrarily long message switch, with the update capability of a very fast out-of-band path hunt processor. For fixed 
cell length operation described previously, the controller 20 of the switch 10A performs path hunts for cells that arrive 
on potentially all of the N input ports, and it must then set up the N paths for all of these routed cells. At the end of the 
1 76 nano second cell interval, all of these N paths are globally torn down, making all of the network connections idle for 
the next cell interval when the entire process is repeated. If variable length cells are permitted, then it should be apparent 
that the global tear-down of all N paths at the end of a cell interval is no longer permitted. In fact, all of the paths from 
one cell interval must be left established in the next cell interval, and individual path tear-downs must be implemented 
whenever the termination of a cell is identified by its respective input interface 12 0 -12 25 5. Thus, to modify ATM switch 
10A to handle variable length cells requires that each input interface 12 0 -12 255 be modified to be capable of identifying 
the start and end of each cell, either with fixed and unique start and end patterns, a unique start pattern coupled with a 
cell length identifier contained within the cell, or some other type of indication. Each modified input interface must then 
be capable of sending two different types of request vectors to a modified controller 20': one to request a path set-up 
and one to request a path tear-down. This can be accomplished by adding a single bit to the 1 6-bit request vector shown 
in FIGs. 13A-13D, where the additional bit is used to indicate whether the request is a set-up request or a tear-down 
request. Upon reception of the request vector, the controller 20' routes the request vector through all four of the pipe 
controllers 24 0 -24 3 (as before), but the link controllers must now be capable of both setting and resetting the busy-idle 
flip-flops in response to the different types of request vectors. In addition, the link controller associated with a particular 
output link must also maintain a memory indicating which input presently has a path established to its output link, because 
only that input is permitted to tear down the path to the output link. The hardware required for all of these functions within 
a link controller is illustrated in FIG. 16. It should be noted that the inclusion of variable length cell routing within the 
distribution network requires that the processing rate within the controller 20' be increased by a factor of two, because 
it is possible that every input may require a single path set-up and a single path tear-down every ATM cell interval. It 
should also be noted that the inclusion of variable length cell routing does not preclude the implementation of any of the 
other features of the switch 10A that have been mentioned previously. 

The use of variable length cells within the switch fabric 14A also requires that the output modules 16 0 -16 15 be 
modified to route cells with different cell lengths. The lengths of the buffers would have to be increased to accommodate 
at least four times the longest cell or packet that can be communicated. 

The rapid acceptance of ATM within the LAN and WAN communities indicates that ATM may already be developing 
a strong foot-hold in the private-switched network environment. As a result, it may be only a matter of time before there 
is a strong demand for ATM services in the public-switched network environment. However, when or if that strong demand 
occurs is uncertain. There is some question within the telecommunications industry of the ability of ATM to efficiently 
provide services that are inherently constant-bit-rate services (voice and video), and also the ability of ATM networks to 
effectively route traffic in a network where the traffic is highly correlated rather than random. Because of this uncertainty, 
ATM service providers and ATM switch vendors must proceed cautiously. A switch based on the switch fabric 14A is a 
sensible system in such uncertain times because the architecture is flexible enough to provide both packet switching 
(ATM) and circuit switching (STM) communications at the same time. Such a switch 10B is shown in FIG. 1 7. Since STM 
switching is a form of circuit switching, and since the switch fabric 14A is essentially a circuit switch with very fast path 
hunting capabilities, the switch fabric 14A is well suited for the routing of STM traffic. A slightly different controller 620 
is required for STM traffic, and the input interfaces 61 2 and output modules 616 provide time-slot interchanger functions 
required by circuit switching equipment, but the single stage switch fabric 14A can remain unaltered in a combination 
STM and ATM switch, or in a wholly STM switch. Simulations have been written to analyze the operation of the switch 
fabric 14A in a wholly STM environment, where an N=256 ATM switch is modified to implement an N=128 STM switch. 
The resulting blocking probability of this N= 128 STM switch has been calculated from this simulation to be less than 
1 x1 0' 9 . This is a very acceptable value in a circuit switched environment where packet loss is not an issue. Thus, switch 
1 0B can vary the percentage of STM traffic it carries up to 1 00 per cent. This flexibility greatly reduces or eliminates the 
possible financial consequences of the uncertainty in the demands of customers for future ATM and STM services. 

The switch fabric 1 4A is essentially technology-independent. An embodiment using free-space digital optics as the 
interconnection technology within the switch fabric is contemplated. The 1 6x1 6 crossbar switches within the switch fabric 
14A will be implemented with FET-SEED device arrays. Such an approach may provide many benefits within the switch 
fabric 14A, because the resulting design based on optical interconnections may have lower levels of signal crosstalk, 
lower chip counts due to increased device integration, lower signal skew, and lower overall power dissipation, which 
results in simpler thermal management techniques within the switch fabric 14A. 
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The packet cell loss of the switch fabric 14A is decreased by the use of a more complicated mapping function. 
Referring to FIG. 18, a methodology is identified that uniquely assigns each input port to a single input on one of the 
16x16 crossbar switches in each of the pipes I8B0-I8B3 of switch fabric 14B so that two input ports will connect to a 
common 16x16 crossbar switch at most once in the entire switch fabric, thereby guaranteeing independence of the 
inputs. The mathematics of finite field theory, i.e., Galois field theory, provide the desired methodology and by applying 
mapping functions based on Galois field theory between the input ports of the fabric 1 4B and the 1 6x1 6 crossbar switches 
17 q -0 to 17 0 -15, 1 7., -0 to 17-1-15. l7 2 -0 to 17 2 -15 and 17 3 -0 to 17 3 -15 independent connections may be determined. 

To determine independent connection for the switch fabric 14B, assume that input port (I) can be represented by 
the eight-bit binary number (i 7 , i 6 , i 5 , i 4 , 13, i 2 . h. io). and assume that the 1 6x1 6 crossbar switch S e (I) to which it is routed 
in pipe e , e.g. pipe 0 through pipe 3 corresponding to pipe 1 8B 0 through 1 8B 3 , can be represented by the six-bit binary 
number (s 5 , s 4 , S3, S2, s-|, s 0 )6 . Using Galois field theory, many different sets of acceptable mapping functions that 
guarantee independence of input ports may be identified. One possible set of acceptable mapping functions for pipes 
18B 0 - I8B3 for input (i 7 , i6, is, i*. i3, i 2 , io) is given below: 

(s 5 , s 4 ,s 3 ,s 2 , s^Sq) 0=(0, 0, i 3 . i 2 . "t "0) 

(s 5 , s 4 , s 3 , s 2 , s,, s 0 ) 1=(0, 1, i 7 XOR i 3 , i 6 XOR i 2 , i 5 XOR i v i 4 XOR i 0 ) 

(s 5 ,s 4 ,s 3 , Sj.s^So) 2=(1,0, i 7 XORi 2 , i 6 XOR i v i 5 XOR i 0 XORi 7 , i 4 XORi 7 ) 

(s 5 , s 4 , s 3 , s 2 , s v s 0 ) 3=(1. 1, i 7 XOR i v i 6 XOR i 0 XORi 7 , i 5 XOR i 7 XOR i 2 , i 4 XOR l 2 ). 

In addition, network input (i 7 , i 6 , i 5 , i 4 , i 3 , i2.iL i 0 ) is connected to inlet i 7 , i 6 , i 5 , i 4 ) on each of the 16x16 crossbar switches 
to which it is routed. When these link mappings, which are based on Galois field theory, are employed, the resulting set 
of interconnections between the input ports and the 16x16 crossbar switches of the switching fabric 14B are Galois 
connections. The results of the above mapping function when applied to the system shown in FIG. 18. are listed in the 
following pages. The connections listed are between switch fabric inputs 0-255 and four input ports on the four 16x16 
crossbar switches in respective pipes 1 8B 0 -1 8B 3 . The list is organized in the following manner. Each input # 0-255, which 
corresponds to a respective output of input interfaces 12o-12 25 5, is fanned out to four switch input ports all having the 
same switch input port number. However, these four switch input ports (which all have the same number) are each on 
a different numbered 16x16 crossbar switch for each respective pipe. For example, input #21 connects to input port 5 
of 16x16 crossbar switch #1 of pipe 18B 0 , input port 5 of 16x16 crossbar switch #4 of pipe 18B-, , input port 5 of 16x16 
crossbar switch #1 1 of pipe 1 8B 2 and input port 5 of 1 6x1 6 crossbar switch #6. Thus, all of the independent connections 
according to the embodiment of the present invention shown in FIG. 5 are listed in the following pages. 
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input #: 0 

switch input port #: 0 
pipe 0 switch #: 0 
pipe 1 switch #: 0 
pipe 2 switch #: 0 
pipe 3 switch #: 0 

input #: 1 

switch input port #: 1 
pipe 0 switch #: 0 
pipe 1 switch #: 1 
pipe 2 switch #: 2 
pipe 3 switch #: 4 

input #: 2 

switch input port #: 2 
pipe 0 switch #: 0 
pipe 1 switch #: 2 
pipe 2 switch #: 4 
pipe 3 switch #: 8 

input #: 3 

switch input port #: 3 
pipe 0 switch #: 0 
pipe 1 switch #: 3 
pipe 2 switch #: 6 
pipe 3 switch #: 12 

input #: 4 

switch input port #: 4 
pipe 0 switch #: 0 
pipe 1 switch #: 4 
pipe 2 switch #: 8 
pipe 3 switch #: 3 

input #: 5 

switch input port #: 5 
pipe 0 switch #: 0 
pipe 1 switch #: 5 
pipe 2 switch #: 10 
pipe 3 switch #: 7 



input #: 128 

switch input port #: 0 
pipe 0 switch #: 8 
pipe 1 switch #: 8 
pipe 2 switch #: 8 
pipe 3 switch #: 8 

input #: 129 

switch input port #: 1 
pipe 0 switch #: 8 
pipe I switch #: 9 
pipe 2 switch #: 10 
pipe 3 switch #: 12 

input #: 130 

switch input port #: 2 
pipe 0 switch #: 8 
pipe 1 switch #: 10 
pipe 2 switch #: 12 
pipe 3 switch #: 0 

input #: 131 

switch input port #: 3 
pipe 0 switch #: 8 
pipe 1 switch #: 1 1 
pipe 2 switch #: 14 
pipe 3 switch #: 4 

input #: 132 

switch input port #: 4 
pipe 0 switch #: 8 
pipe 1 switch #: 12 
pipe 2 switch #: 0 
pipe 3 switch #: 1 1 

input #: 133 

switch input port #: 5 
pipe 0 switch #: 8 
pipe 1 switch #: 13 
pipe 2 switch #: 2 
pipe 3 switch #: 15 



16 
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input #: 6 

switch input port #: 6 
pipe 0 switch #: 0 
pipe 1 switch #: 6 
pipe 2 switch #: 12 
pipe 3 switch #: 1 1 

input #: 7 

switch input port #: 7 
pipe 0 switch #: 0 
pipe 1 switch #: 7 
pipe 2 switch #: 14 
pipe 3 switch #: 1 5 

input #: 8 

switch input port #: 8 
pipe 0 switch #: 0 
pipe 1 switch #: 8 
pipe 2 switch #: 3 
pipe 3 switch #: 6 

input #: 9 

switch input port #: 9 
pipe 0 switch #: 0 
pipe 1 switch #: 9 
pipe 2 switch #: 1 
pipe 3 switch #: 2 

input #: 10 

switch input port #: 10 
pipe 0 switch #: 0 
pipe 1 switch #: 10 
pipe 2 switch #: 7 
pipe 3 switch #: 14 

input #: 11 

switch input port #: 1 1 
pipe 0 switch #: 0 
pipe 1 switch #: 1 1 
pipe 2 switch #: 5 
pipe 3 switch #: 10 



input #: 134 

switch input port #: 6 
pipe 0 switch #: 8 
pipe 1 switch #: 14 
pipe 2 switch #: 4 
pipe 3 switch #: 3 

input #: 135 

switch input port #: 7 
pipe 0 switch #: 8 
pipe 1 switch #: 15 
pipe 2 switch #: 6 
pipe 3 switch #: 7 

input #: 136 

switch input port #: 8 
pipe 0 switch #: 8 
pipe 1 switch #: 0 
pipe 2 switch #: 1 1 
pipe 3 switch #: 14 

input #: 137 

switch input port #: 9 
pipe 0 switch #: 8 
pipe 1 switch #: 1 
pipe 2 switch #: 9 
pipe 3 switch #: 10 

input #: 138 

switch input port #: 10 
pipe 0 switch #: 8 
pipe 1 switch #: 2 
pipe 2 switch #: 15 
pipe 3 switch #: 6 

input*: 139 

switch input port #: 11 
pipe 0 switch #: 8 
pipe 1 switch #: 3 
pipe 2 switch #:13 
pipe 3 switch #: 2 
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input #: 12 


input #: 140 


5 


switch input port #: 1 2 


switch input port #: 12 




pipe 0 switch tt\ 0 


pipe 0 switch #: 8 




pipe 1 switch #: 1 2 


pipe 1 switch #: 4 




pipe 2 switch #: 1 1 


pipe 2 switch #: 3 


10 


pipe 3 switch #: 5 


pipe 3 switch #: 1 3 




input #: 1 3 


input #: 141 




switch input port #: 13 


switch input port #: 13 




pipe 0 switch #: 0 


pipe 0 switch #: 8 


15 


pipe 1 switch #: 1 3 


pipe 1 switch #: 5 




pipe 2 switch #: 9 


pipe 2 switch #: 1 




pipe 3 switch #: 1 


pipe 3 switch #: 9 




input #: 14 


input #: 142 


SO 


switch input port #: 14 


switch input port #: 14 




pipe 0 switch $* 0 


pipe 0 switch $i 8 




pipe 1 switch #: 14 


pipe 1 switch #: 6 




pipe 2 switch #: 15 


pipe 2 switch #: 7 


25 


pipe 3 switch #: 13 


pipe 3 switch #: 5 




input #: 15 


input #: 143 




switch input port #: 15 


switch input port #: 1 5 


30 


pipe 0 switch $i 0 


pipe 0 switch M-'. 8 




pipe 1 switch #: 1 5 


pipe 1 switch #: 7 




pipe 2 switch #: 13 


pipe 2 switch #: 5 


35 


pipe 3 switch #: 9 


pipe 3 switch #: 1 




input #: 16 


input #: 144 




switch input port #: 0 


switch input port #: 0 




pipe \J ownui rr. 1 


pipe 0 switch 9 


40 


pipe 1 switch #: 1 


pipe 1 switch #: 9 




pipe 2 switch #: 1 


pipe 2 switch #: 9 




pipe 3 switch #: 1 


pipe 3 switch #: 9 


45 


input #: 17 


input #: 145 




switch input port #: 1 


switch input port#:l 




pipe 0 switch #: 1 


pipe 0 switch #: 9 




pipe 1 switch #: 0 


pipe 1 switch #: 8 


50 


pipe 2 switch #: 3 


pipe 2 switch #: 1 1 




pipe 3 switch #: 5 


pipe 3 switch #: 13 
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input #: 18 
switch input port #: 2 
pipe 0 switch #: 1 
pipe 1 switch #: 3 
pipe 2 switch #: 5 
pipe 3 switch #: 9 

input #: 19 
switch input port #: 3 
pipe 0 switch #: 1 
pipe 1 switch #: 2 
pipe 2 switch #: 7 
pipe 3 switch #: 13 

input #: 20 
switch input port #: 4 
pipe 0 switch #: 1 
pipe 1 switch #: 5 
pipe 2 switch #: 9 
pipe 3 switch #: 2 

input #: 21 

switch input port #: 5 
pipe 0 switch #: 1 
pipe 1 switch #: 4 
pipe 2 switch #: 1 1 
pipe 3 switch #: 6 

input #: 22 
switch input port #: 6 
pipe 0 switch #: 1 
pipe 1 switch #: 7 
pipe 2 switch #: 13 
pipe 3 switch #: 10 

input #: 23 

switch input port #: 7 
pipe 0 switch #: 1 
pipe 1 switch #: 6 
pipe 2 switch #: 1 5 
pipe 3 switch #: 14 



input #: 146 

switch input port #: 2 
pipe 0 switch #: 9 
pipe 1 switch #: 1 1 
pipe 2 switch #: 13 
pipe 3 switch #: 1 

input #: 147 

switch input port #: 3 
pipe 0 switch #: 9 
pipe 1 switch #: 10 
pipe 2 switch #: 15 
pipe 3 switch #: 5 

input #: 148 

switch input port #: 4 
pipe 0 switch #: 9 
pipe 1 switch #: 13 
pipe 2 switch #: 1 
pipe 3 switch #: 10 

input #: 149 

switch input port #: 5 
pipe 0 switch #: 9 
pipe 1 switch #: 12 
pipe 2 switch #: 3 
pipe 3 switch #: 14 

input #: 150 

switch input port #: 6 
pipe 0 switch #: 9 
pipe 1 switch #: 15 
pipe 2 switch #: 5 
pipe 3 switch #: 2 

input #: 151 

switch input port #: 7 
pipe 0 switch #: 9 
pipe 1 switch #: 14 
pipe 2 switch #: 7 
pipe 3 switch #: 6 
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input #: 24 
switch input port #: 8 
pipe 0 switch #: 1 
pipe 1 switch #: 9 
pipe 2 switch #: 2 
pipe 3 switch #: 7 

input #: 25 
switch input port #: 9 
pipe 0 switch #: 1 
pipe 1 switch #: 8 
pipe 2 switch #: 0 
pipe 3 switch #: 3 

input #: 26 

switch input port #: 10 
pipe 0 switch #: 1 
pipe 1 switch #: 1 1 
pipe 2 switch #: 6 
pipe 3 switch #: 15 

input #: 27 

switch input port #: 1 1 
pipe 0 switch #: 1 
pipe 1 switch #: 1 0 
pipe 2 switch •#: 4 
pipe 3 switch #: 1 1 

input #: 28 

switch input port #: 12 
pipe 0 switch #: 1 
pipe 1 switch #: 13 
pipe 2 switch #: 10 
pipe 3 switch #: 4 

input #: 29 

switch input port #: 1 3 
pipe 0 switch #: 1 
pipe 1 switch #: 12 
pipe 2 switch #: 8 
pipe 3 switch #: 0 



input #: 152 

switch input port #: 8 
pipe 0 switch #: 9 
pipe 1 switch #: 1 
pipe 2 switch #: 10 
pipe 3 switch #: 15 

input #: 153 

switch input port #: 9 
pipe 0 switch #: 9 
pipe 1 switch #: 0 
pipe 2 switch #: 8 
pipe 3 switch #: 1 1 

input #: 154 

switch input port #: 10 
pipe 0 switch #: 9 
pipe 1 switch #: 3 
pipe 2 switch #: 14 
pipe 3 switch #: 7 

input #: 155 

switch input port #: 1 1 
pipe 0 switch #: 9 
pipe 1 switch #: 2 
pipe 2 switch #: 12 
pipe 3 switch #: 3 

input #: 156 

switch input port #: 12 
pipe 0 switch #: 9 
pipe 1 switch #: 5 
pipe 2 switch #: 2 
pipe 3 switch #: 12 

input #: 157 

switch input port #: 13 
pipe 0 switch #: 9 
pipe 1 switch #: 4 
pipe 2 switch #: 0 
pipe 3 switch #: 8 



20 
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input #: 30 

switch input port #: 14 
pipe 0 switch #: 1 
pipe 1 switch #: 15 
pipe 2 switch #: 14 
pipe 3 switch #: 12 

input #: 31 

switch input port #: 15 
pipe 0 switch #: 1 
pipe 1 switch #: 14 
pipe 2 switch #: 12 
pipe 3 switch #: 8 
input #: 32 

switch input port #: 0 
pipe 0 switch #: 2 
pipe 1 switch #: 2 
pipe 2 switch #: 2 
pipe 3 switch #: 2 

input #: 33 

switch input port #: 1 
pipe 0 switch #: 2 
pipe 1 switch #: 3 
pipe 2 switch #: 0 
pipe 3 switch #: 6 

input #: 34 
switch input port #: 2 
pipe 0 switch #: 2 
pipe 1 switch #: 0 
pipe 2 switch #: 6 
pipe 3 switch #: 10 

input #: 35 

switch input port #: 3 
pipe 0 switch #:2 
pipe 1 switch #: 1 
pipe 2 switch #: 4 
pipe 3 switch #: 14 



input #: 158 
switch input port #: 14 
pipe 0 switch #: 9 
pipe 1 switch #: 7 
pipe 2 switch #: 6 
pipe 3 switch #: 4 

inpUt# '- 159 rt *-15 
switch input port #• ^ 

pipe 0 switch #: 9 

pipe 1 switch #: 6 

pipe 2 switch #: 4 

pipe 3 switch #: 0 

input #: 160 

switch input port #:0 

pipe 0 switch #: 10 
pipe 1 switch #: 10 
pipe 2 switch #: 10 
pipe 3 switch #: 10 

input #:161 
switch input port #: 1 
pipe 0 switch #: 10 
pipe 1 switch #: H 
pipe 2 switch #: 8 
pipe 3 switch #: 14 

input #: 162 
switch input port 

pipe 0 switch #: 10 
pipe 1 switch #: 8 
pipe 2 switch #: 14 
pipe 3 switch #: 2 

input #: 163 
switch input port #: 3 
pipe 0 switch #: 10 
pipe 1 switch #: 9 
pipe 2 switch #: 12 
pipe 3 switch #: 6 
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input #: 36 
switch input port #: 4 
pipe 0 switch #: 2 
pipe 1 switch #: 6 
pipe 2 switch #: 10 
pipe 3 switch #: 1 

input #: 37 
switch input port #: 5 
pipe 0 switch #: 2 
pipe 1 switch #: 7 
pipe 2 switch #: 8 
pipe 3 switch #: 5 



input #: 164 

switch input port #: 4 
pipe 0 switch #: 10 
pipe 1 switch #: 14 
pipe 2 switch #: 2 
pipe 3 switch #: 9 

input #: 165 

switch input port #: 5 
pipe 0 switch #: 10 
pipe 1 switch #: 1 5 
pipe 2 switch #: 0 
pipe 3 switch #: 1 3 



input #: 38 

switch input port #: 6 
pipe 0 switch #: 2 
pipe 1 switch #: 4 
pipe 2 switch #: 14 
pipe 3 switch #: 9 
input #: 39 
switch input port #: 7 
pipe 0 switch #: 2 
pipe 1 switch #: 5 
pipe 2 switch #: 12 
pipe 3 switch #: 13 

input #: 40 
switch input port #: 8 
pipe 0 switch #: 2 
pipe 1 switch #: 10 
pipe 2 switch #: 1 
pipe 3 switch #: 4 



input #: 166 

switch input port #: 6 
pipe 0 switch #: 10 
pipe 1 switch #: 12 
pipe 2 switch #: 6 
pipe 3 switch #: 1 

input #: 167 

switch input port #: 7 
pipe 0 switch #: 10 
pipe 1 switch #: 13 
pipe 2 switch #: 4 
pipe 3 switch #: 5 

input #: 168 

switch input port #: 8 
pipe 0 switch #: 10 
pipe 1 switch #: 2 
pipe 2 switch #: 9 
pipe 3 switch #: 12 



input #: 41 

switch input port #: 9 
pipe 0 switch #: 2 
pipe 1 switch #: 1 1 
pipe 2 switch #: 3 
pipe 3 switch #: 0 



input #: 169 

switch input port #: 9 
pipe 0 switch #: 10 
pipe 1 switch #: 3 
pipe 2 switch #: 1 1 
pipe 3 switch #: 8 
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input #: 42 

switch input port #: 10 
pipe 0 switch #: 2 
pipe 1 switch #: 8 
pipe 2 switch #: 5 
pipe 3 switch #: 12 

input #: 43 

switch input port #: 11 
pipe 0 switch #: 2 
pipe I switch #: 9 
pipe 2 switch #: 7 
pipe 3 switch #: 8 

input »: 44 

switch input port #: 12 
pipe 0 switch #: 2 
pipe I switch*: 14 
pipe 2 switch #: 9 
pipe 3 switch #: 7 

input *. 45 

switch input port #: 13 
pipe 0 switch #: 2 
pipe 1 switch #: 15 
pipe 2 switch #: 1 1 
pipe 3 switch #: 3 
input *: 46 

switch input port #: 14 
pipe 0 switch #: 2 
pipe 1 switch #: 12 
pipe 2 switch #: 13 
pipe 3 switch #: 15 

input »: 47 

switch input port #: 15 
pipe 0 switch #: 2 
pipe I switch #: 13 
pipe 2 switch #: 15 
pipe 3 switch #: 1 1 



input U: 170 

switch input port #: 10 
pipe 0 switch #: 10 
pipe 1 switch #: 0 
pipe 2 switch #: 13 
pipe 3 switch #: 4 

input #: 171 

switch input port #: 1 1 
pipe 0 switch #: 10 
pipe 1 switch #: 1 
pipe 2 switch #: 15 
pipe 3 switch #: 0 

input #: 172 

switch input port #: 12 
pipe 0 switch #: 10 
pipe 1 switch #: 6 
pipe 2 switch #: 1 
pipe 3 switch #: 15 

input #: 173 

switch input port #: 13 
pipe 0 switch #: 10 
pipe 1 switch #: 7 
pipe 2 switch #: 3 
pipe 3 switch #: 1 1 

input #: 174 

switch input port #: 14 
pipe 0 switch #: 10 
pipe 1 switch #: 4 
pipe 2 switch #: 5 
pipe 3 switch #: 7 

input #: 175 

switch input port #: 1 5 
pipe 0 switch #: 10 
pipe 1 switch #: 5 
pipe 2 switch #: 7 
pipe 3 switch #: 3 
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input #: 48 


input #: 176 


5 


switch input port #: 0 


switch input port #: 0 




pipe 0 switch #: 3 


pipe 0 switch 11 




pipe 1 switch #: 3 


pipe 1 switch #: 1 1 




pipe 2 switch #: 3 


pipe 2 switch #: 1 1 


10 


pipe 3 switch #: 3 


pipe 3 switch #: 1 1 




input #: 49 


input #: 1 77 




switch input port #: 1 


switch input port #: 1 




pipe 0 switch 3 


pipe 0 switch 1 1 


15 


pipe 1 switch #: 2 


pipe 1 switch #: 10 




pipe 2 switch #: 1 


pipe 2 switch #: 9 




pipe 3 switch #: 7 


pipe 3 switch #: 1 5 


20 


input #: 50 


input #: 178 




switch input port #: 2 


switch input port #: 2 




pipe 0 switch #: 3 


pipe 0 switch 11 




pipe 1 switch #: 1 


pipe 1 switch #: 9 


25 


pipe 2 switch #: 7 


pipe 2 switch #: 15 




pipe 3 switch #: 1 1 


pipe 3 switch #: 3 




input #: 51 


input #: 179 


30 


switch input port #: 3 


switch input port #: 3 




pipe 0 switch #: 3 


pipe 0 switch 11 




pipe 1 switch #: 0 


pipe 1 switch #: 8 




pipe 2 switch #: 5 


pipe 2 switch #: 13 


35 


pipe 3 switch #: 15 


pipe 3 switch #: 7 




input #: 52 


input #: 180 




switch input port #: 4 


switch input port #: 4 


40 


pipe 0 switch #: 3 


pipe 0 switch U-\ 1 1 




pipe 1 switch #: 7 


pipe 1 switch #: 15 




pipe 2 switch #: 1 1 


pipe 2 switch #: 3 


45 


pipe 3 switch #: 0 


pipe 3 switch #: 8 




input #: 53 


input #: 181 




switch input port #: 5 


switch input port #: 5 




pipe 0 switch #: 3 


pipe 0 switch #: 1 1 


50 


pipe 1 switch #: 6 


pipe 1 switch #: 14 




pipe 2 switch #: 9 


pipe 2 switch #: 1 




pipe 3 switch #: 4 


pipe 3 switch #: 12 



55 
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input #: 54 

switch input port #: 6 

pipe 0 switch #: 3 
pipe 1 switch #: 5 
pipe 2 switch #: 15 
pipe 3 switch #: 8 

input #:55 
switch input port #: / 
pipe 0 switch #: 3 
pipe 1 switch #: 4 
pipe 2 switch #: 13 
pipe 3 switch #: 12 

input #: 56 
switch input port #•» 
pipe 0 switch #: 3 
pipe 1 switch #: H 
pipe 2 switch #: 0 
pipe 3 switch #: 5 

input #:57 

switch input port*, v 
pipe 0 switch #: 3 
pipe 1 switch- #: 10 
pipe 2 switch #: 2 
pipe 3 switch #: 1 

input #: 58 

switch input port #: 10 
pipe 0 switch #: 3 
pipe 1 switch #•• 9 
pipe 2 switch #: 4 
pipe 3 switch #: 13 

input #: 59 

switch input port #. u 
pipe 0 switch #: 3 
pipe 1 switch #: 8 
pipe 2 switch #: 6 
pipe 3 switch #: 9 



input #: 182 

switch input port #: 6 
pipe 0 switch #: 1 1 
pipe 1 switch #: 13 
pipe 2 switch #: 7 
pipe 3 switch #: 0 

input #: 1 83 

switch input port #:7 

pipe 0 switch #: H 
pipe 1 switch #•■ 12 
pipe 2 switch #: 5 
pipe 3 switch #: 4 

input*: l«4 
switch input port #. 8 
pipe 0 switch #: H 
pipe 1 switch #: 3 
pipe 2 switch #: 8 
pipe 3 switch #•• 13 

input #: 185 
switch input port #. 9 
pipe 0 switch #: H 
pipe 1 switch #: 2 
pipe 2 switch #•• 10 
pipe 3 switch #: 9 



input 



#: 186 



switch input port #: 10 



pipe 



0 switch #•• 1 1 



pipe 1 switch #•• 1 
pipe 2 switch #: 12 
pipe 3 switch #: 5 

input #:187 
switch input port #: U 
pipe 0 switch #: 1 1 
pipe 1 switch #: 0 
pipe 2 switch *: 14 
pipe 3 switch #: 1 
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input #: 60 

switch input port #: 12 
pipe 0 switch #: 3 
pipe 1 switch #: 1 5 
pipe 2 switch #: 8 
pipe 3 switch #: 6 

input #: 61 

switch input port #: 13 
pipe 0 switch #: 3 
pipe 1 switch #: 14 
pipe 2 switch #: 10 
pipe 3 switch #: 2 

input #: 62 

switch input pon #: 14 
pipe 0 switch #: 3 
pipe I switch #: 13 
pipe 2 switch #: 12 
pipe 3 switch #: 14 

input #: 63 

switch input port #: 15 
pipe 0 switch #: 3 
pipe 1 switch #: 12 
pipe 2 switch #: 14 
pipe 3 switch #: 10 

input #: 64 
switch input port #: 0 
pipe 0 switch #: 4 
pipe 1 switch #: 4 
pipe 2 switch #: 4 
pipe 3 switch #: 4 

input #: 65 
switch input port #: 1 
pipe 0 switch #: 4 
pipe 1 switch #: 5 
pipe 2 switch #: 6 
pipe 3 switch #: 0 



input #: 188 

switch input port #: 12 
pipe 0 switch #: 1 1 
pipe 1 switch #: 7 
pipe 2 switch #: 0 
pipe 3 switch #: 14 

input #: 189 

switch input port #: 1 3 
pipe 0 switch #: 1 1 
pipe 1 switch #: 6 
pipe 2 switch #: 2 
pipe 3 switch #: 10 

input #: 190 

switch input port #: 14 
pipe 0 switch #: 1 1 
pipe 1 switch #: 5 
pipe 2 switch #: 4 
pipe 3 switch #: 6 

input #: 191 

switch input port #: 15 
pipe 0 switch #: 1 1 
pipe 1 switch #: 4 
pipe 2 switch #: 6 
pipe 3 switch #: 2 

input #: 192 

switch input port #: 0 
pipe 0 switch #: 12 
pipe 1 switch #: 12 
pipe 2 switch #: 12 
pipe 3 switch #: 12 

input #: 193 

switch input port #: 1 
pipe 0 switch #: 12 
pipe 1 switch #: 13 
pipe 2 switch #: 14 
pipe 3 switch #: 8 
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input #: 66 
switch input port #: 2 
pipe 0 switch #: 4 
pipe l switch #: 6 
pipe 2 switch #: 0 
pipe 3 switch #: 1 2 

input #: 67 
switch input port #: 3 
pipe 0 switch #: 4 
pipe l switch #: 7 
pipe 2 switch #: 2 
pipe 3 switch #: 8 

input #: 68 

switch input port #: 4 
pipe 0 switch #: 4 
pipe l switch #: 0 
pipe 2 switch #: 12 
pipe 3 switch #: 7 

input #: 69 
switch input port #: 5 
pipe 0 switch #: 4 
pipe 1 switch #: 1 
pipe 2 switch #: 14 
pipe 3 switch #: 3 

input #: 70 
switch input port #: 6 
pipe 0 switch #: 4 
pipe 1 switch #: 2 
pipe 2 switch #: 8 
pipe 3 switch #: 15 

input #: 71 
switch inp 



input #: 194 

switch input port #: 2 
pipe 0 switch #: 12 
pipe 1 switch #: 14 
pipe 2 switch #: 8 
pipe 3 switch #: 4 

input #: 195 

switch input port #: 3 
pipe 0 switch #: 12 
pipe 1 switch #: 1 5 
pipe 2 switch #: 10 
pipe 3 switch #: 0 

input #: 196 

switch input port #: 4 
pipe 0 switch #: 12 
pipe 1 switch #: 8 
pipe 2 switch #: 4 
pipe 3 switch #: 15 

input #: 197 

switch input port #: 5 
pipe 0 switch #: 12 
pipe 1 switch #: 9 
pipe 2 switch #: 6 
pipe 3 switch #: 1 1 

input #: 198 

switch input port #: 6 
pipe 0 switch #: 12 
pipe 1 switch #: 10 
pipe 2 switch #: 0 
pipe 3 switch #: 7 

input #: 199 
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input U: 72 


input #: 200 


switch input port #: 8 


switch input port #: 8 


pipe 0 switch #: 4 


pipe 0 switch #: 12 


pipe 1 switch #: 12 


pipe 1 switch #: 4 


pipe 2 switch #: 7 


pipe 2 switch #: 1 5 


pipe 3 switch #: 2 


pipe 3 switch #: 10 


input #: 73 


input #: 201 


switch input port #: 9 


switch input port #: 9 


pipe 0 switch #: 4 


pipe 0 switch #: 12 


pipe 1 switch #: 13 


pipe 1 switch #: 5 


pipe 2 switch #: 5 


pipe 2 switch #: 13 


pipe 3 switch #: 6 


pipe 3 switch #: 14 


input #: 74 


input #: 202 


switch input port #: 10 


switch input port #: 10 


pipe 0 switch #: 4 


pipe 0 switch #: 12 


pipe 1 switch #: 14 


pipe 1 switch #: 6 


pipe 2 switch #: 3 


pipe 2 switch #: 1 1 


pipe 3 switch #: 10 


pipe 3 switch #: 2 


input #: 75 


input #: 203 


switch input port #: 1 1 


switch input port #: 1 1 


pipe 0 switch #: 4 


pipe 0 switch #: 12 


pipe 1 switch #: 15 


pipe 1 switch #: 7 


pipe 2 switch #: 1 


pipe 2 switch #: 9 


pipe 3 switch #: 14 


pipe 3 switch #: 6 


input #: 76 


input #: 204 


switch input port #: 12 


switch input port #: 12 


pipe 0 switch #: 4 


pipe 0 switch #: 12 


pipe 1 switch #: 8 


pipe 1 switch #: 0 


pipe 2 switch #: 15 


pipe 2 switch #: 7 


pipe 3 switch #: 1 


pipe 3 switch #: 9 


input #: 77 


input #: 205 


switch input port #: 13 


switch input port #: 1 3 


pipe 0 switch #: 4 


pipeO switch #: 12 


pipe 1 switch #: 9 


pipe 1 switch #: 1 


pipe 2 switch #: 13 


pipe 2 switch #: 5 


pipe 3 switch #: 5 


pipe 3 switch #: 1 3 



55 
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input #: 78 

switch input port #: 14 
pipe 0 switch #: 4 
pipe 1 switch #: 10 
pipe 2 switch #: 1 1 
pipe 3 switch #: 9 

input #: 79 

switch input port #: 1 5 
pipe 0 switch #: 4 
pipe 1 switch #: 1 1 
pipe 2 switch #: 9 
pipe 3 switch #: 13 

input #: 80 
switch input port #: 0 
pipe 0 switch #: 5 
pipe 1 switch #: 5 
pipe 2 switch #: 5 
pipe 3 switch #: 5 

input #: 81 
switch input port #: 1 
pipe 0 switch #: 5 
pipe 1 switch #: 4 
pipe 2 switch #: 7 
pipe 3 switch #: 1 

input #: 82 
switch input port #: 2 
pipe 0 switch #: 5 
pipe 1 switch #: 7 
pipe 2 switch #: 1 
pipe 3 switch #: 13 

input #: 83 
switch input port #: 3 
pipe 0 switch #: 5 
pipe 1 switch #: 6 
pipe 2 switch #: 3 
pipe 3 switch #: 9 



input #: 206 

switch input port #: 14 
pipe 0 switch #: 12 
pipe 1 switch #: 2 
pipe 2 switch #: 3 
pipe 3 switch #: 1 

input #: 207 

switch input port #: 15 
pipe 0 switch #: 12 
pipe 1 switch #: 3 
pipe 2 switch #: 1 
pipe 3 switch #: 5 

input #: 208 

switch input port #: 0 
pipe 0 switch #: 13 
pipe 1 switch #: 13 
pipe 2 switch #: 13 
pipe 3 switch #: 13 

input #: 209 

switch input port #: 1 
pipe 0 switch #: 13 
pipe 1 switch #: 12 
pipe 2 switch #: 15 
pipe 3 switch #: 9 

input #: 210 

switch input port #: 2 
pipe 0 switch #: 13 
pipe 1 switch #: 15 
pipe 2 switch #: 9 
pipe 3 switch #: 5 

input #: 211 

switch input port #: 3 
pipe 0 switch #: 13 
pipe 1 switch #: 14 
pipe 2 switch #: 1 1 
pipe 3 switch #: 1 
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input #: 84 


input #: 212 


switch input port #: 4 


switch input port #: 4 


pipe 0 switch #: 5 


pipe 0 switch #: 1 3 


pipe 1 switch #: 1 


pipe 1 switch #: 9 


pipe 2 switch #: 13 


pipe 2 switch #: 5 


pipe 3 switch #: 6 


pipe 3 switch #: 14 


input #: 85 


input #: 213 


switch input port #: 5 


switch input port #: 5 


pipe 0 switch #: 5 


pipe 0 switch #: 13 


pipe 1 switch #: 0 


pipe 1 switch #: 8 


pipe 2 switch #: 1 5 


pipe 2 switch #: 7 


pipe 3 switch #: 2 


pipe 3 switch #: 10 


input #: 86 


input #: 214 


switch input port #: 6 


switch input port #: 6 


pipe 0 switch #: 5 


pipe 0 switch #: 13 


pipe 1 switch #: 3 


pipe 1 switch #: 1 1 


pipe 2 switch #: 9 


pipe 2 switch #: 1 


pipe 3 switch #: 14 


pipe 3 switch #: 6 


input #: 87 


input #: 215 


switch input port #: 7 


switch input port #: 7 


pipe 0 switch #: 5 


pipe 0 switch #: 13 


pipe 1 switch #: 2 


pipe 1 switch #: 10 


pipe 2 switch #: 1 1 


pipe 2 switch #: 3 


pipe 3 switch #: 10 


pipe 3 switch #: 2 


input #: 88 


input #: 216 


switch input port #: 8 


switch input port #: 8 


pipe 0 switch #: 5 


pipe 0 switch #: 1 3 


pipe 1 switch #: 13 


pipe 1 switch #: 5 


pipe 2 switch #: 6 


pipe 2 switch #: 14 


pipe 3 switch #: 3 


pipe 3 switch #: 1 1 


input #: 89 


input #: 217 


switch input port #: 9 


switch input port #: 9 


pipe 0 switch #: 5 


pipe 0 switch #: 13 


pipe 1 switch #: 12 


pipe 1 switch #: 4 


pipe 2 switch #: 4 


pipe 2 switch #: 12 


pipe 3 switch #: 7 


pipe 3 switch #: 1 5 



55 
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input #: 90 

switch input port #: 10 
pipe 0 switch #: 5 
pipe 1 switch #: 15 
pipe 2 switch #: 2 
pipe 3 switch #: 1 1 

input #: 91 

switch input port #: 1 1 
pipe 0 switch #: 5 
pipe 1 switch #: 14 
pipe 2 switch #: 0 
pipe 3 switch #: 15 

input #: 92 

switch input port #: 12 
pipe 0 switch #: 5 
pipe 1 switch #: 9 
pipe 2 switch #: 14 
pipe 3 switch #: 0 
input #: 93 

switch input port #: 13 
pipe 0 switch #: 5 
pipe 1 switch #: 8 
pipe 2 switch #: 12 
pipe 3 switch #: 4 

input #: 94 

switch input port #: 14 
pipe 0 switch #: 5 
pipe 1 switch #: 1 1 
pipe 2 switch #: 10 
pipe 3 switch #: 8 

input #: 95 

switch input port 15 
pipe 0 switch #: 5 
pipe 1 switch #: 10 
pipe 2 switch #: 8 
pipe 3 switch #: 12 



inputs: 218 

switch input port #: 10 
pipe 0 switch #: 13 
pipe 1 switch #: 7 
pipe 2 switch #: 10 
pipe 3 switch #: 3 

inpUt# '- 219 „*U 
switch input port ff. u 

pipe 0 switch #: 13 

pipe 1 switch #: 6 

pipe 2 switch #: 8 

pipe 3 switch #: 7 

input #: 220 
switch input port #. U 
pipe 0 switch #: 13 
pipe 1 switch #: 1 
pipe 2 switch #: 6 
pipe 3 switch #: 8 
input #:221 
switch input port #. li 
pipe 0 switch #: 13 
pipe 1 switch #: 0 
pipe 2 switch #: 4 
pipe 3 switch #: 12 

input #:222 

switch input port #• ^ 
pipe 0 switch #: 13 
pipe 1 switch #: 3 

pipe 2 switch #: 2 

pipe 3 switch #: 0 

input #: 223 

switch input port #. is 
pipe 0 switch #: 13 
pipe 1 switch #: 2 

pipe 2 switch #: 0 

pipe 3 switch #: 4 
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input #: 96 
switch input port #: 0 
pipe 0 switch #: 6 
pipe 1 switch #: 6 
pipe 2 switch #: 6 
pipe 3 switch #: 6 

input #: 97 
switch input port #: 1 
pipe 0 switch #: 6 
pipe 1 switch #: 7 
pipe 2 switch #: 4 
pipe 3 switch #: 2 

input #: 98 
switch input port #: 2 
pipe 0 switch #: 6 
pipe 1 switch #: 4 
pipe 2 switch #: 2 
pipe 3 switch #: 14 

input #: 99 
switch input port #: 3 
pipe 0 switch #: 6 
pipe 1 switch #: 5 
pipe 2 switch #: 0 
pipe 3 switch #: 10 
input #: 100 
switch input port #: 4 
pipe 0 switch #: 6 
pipe 1 switch #: 2 
pipe 2 switch #: 14 
pipe 3 switch #: 5 

input #: 101 
switch input port #: 5 
pipe 0 switch #: 6 
pipe 1 switch #: 3 
pipe 2 switch #: 12 
pipe 3 switch #: 1 



input #: 224 

switch input port #: 0 
pipe 0 switch #: 14 
pipe 1 switch #: 14 
pipe 2 switch #: 14 
pipe 3 switch #: 14 

input #: 225 

switch input port #: 1 
pipe 0 switch #: 14 
pipe 1 switch #: 15 
pipe 2 switch #: 12 
pipe 3 switch #: 10 

input #: 226 

switch input port #: 2 
pipe 0 switch #: 14 
pipe 1 switch #: 1 2 
pipe 2 switch #: 10 
pipe 3 switch #: 6 

input #: 227 

switch input port #: 3 
pipe 0 switch #: 14 
pipe 1 switch #: 13 
pipe 2 switch #: 8 
pipe 3 switch #: 2 

input #: 228 

switch input port #: 4 
pipe 0 switch #: 14 
pipe 1 switch #: 10 
pipe 2 switch #: 6 
pipe 3 switch #: 13 

input #: 229 

switch input port #: 5 
pipe 0 switch #: 14 
pipe 1 switch #: 11 
pipe 2 switch #: 4 
pipe 3 switch #: 9 



32 
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input #: 102 
switch input port #: 6 
pipe 0 switch #: 6 
pipe 1 switch #: 0 
pipe 2 switch #: 10 
pipe 3 switch #: 13 

input #: 103 
switch input port #: 7 
pipe 0 switch #: 6 
pipe 1 switch #: 1 
pipe 2 switch #: 8 
pipe 3 switch #: 9 

input #: 104 
switch input port #: 8 
pipe 0 switch #: 6 
pipe 1 switch #: 14 

pipe 2 switch #: 5 

pipe 3 switch #: 0 

input #: 105 

switch input port #: 9 

pipe 0 switch #: 6 
pipe 1 switch #: 15 
pipe 2 switch .#: 7 
pipe 3 switch #: 4 

input #:106 
switch input port #: 10 
pipe 0 switch #: 6 
pipe 1 switch #: 12 
pipe 2 switch #: 1 
pipe 3 switch #: 8 
input #:107 
switch input port #. u 
pipe 0 switch #: 6 
pipe 1 switch #: 13 
pipe 2 switch #: 3 
pipe 3 switch #: 12 



input #: 230 

switch input port #: 6 
pipe 0 switch #: 14 
pipe 1 switch #: 8 
pipe 2 switch #: 2 

pipe 3 switch #: 5 

input #.231 
switch input port #: 7 
pipe 0 switch #: 14 
pipe 1 switch #: 9 
pipe 2 switch #: 0 
pipe 3 switch #: 1 

input #: 232 
switch input port #: 8 
pipe 0 switch #: 14 
pipe 1 switch #: 6 
pipe 2 switch #: 13 
pipe 3 switch #: 8 

input #:233 

switch input port #. v 
pipe 0 switch #: 14 
pipe 1 switch #: 7 
pipe 2 switch #: 15 

pipe 3 switch*: 12 

input #: 234 
switch input port #: 10 
pipe 0 switch #: 14 
pipe 1 switch #: 4 
pipe 2 switch #: 9 
pipe 3 switch #: 0 
input #: 235 
switch input port #• H 
pipe 0 switch #: 14 
pipe 1 switch #: 5 
pipe 2 switch #: U 
pipe 3 switch #: 4 
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input #: 108 


input #: 236 


switch input port #: 12 


switch input port #: 


pipe 0 switch #: 6 


pipe 0 switch #: 14 


pipe 1 switch #: 10 


pipe 1 switch #: 2 


pipe 2 switch #: 1 3 


pipe 2 switch #: 5 


pipe 3 switch #: 3 


pipe 3 switch #: 1 1 


input #: 109 


input #: 237 


switch input port #: 13 


switch input port #: 


pipe 0 switch #: 6 


pipe 0 switch #: 14 


pipe 1 switch #: 1 1 


pipe 1 switch #: 3 


pipe 2 switch #: 15 


pipe 2 switch #: 7 


pipe 3 switch #: 7 


pipe 3 switch #: 15 


input #: 110 


input #: 238 


switch input port #: 14 


switch input port #: 


pipe 0 switch #; 6 


pipe 0 switch #: 14 


pipe 1 switch #: 8 


pipe 1 switch #: 0 


pipe 2 switch #: 9 


pipe 2 switch #: 1 


pipe 3 switch #: 1 1 


pipe 3 switch #: 3 


input #: 1 1 1 


input #: 239 


switch input port #: 15 


switch input port #: 


pipe 0 switch #: 6 


pipe 0 switch #: 14 


pipe 1 switch #: 9 


pipe 1 switch #: 1 


pipe 2 switch #: 1 1 


pipe 2 switch #: 3 


pipe 3 switch #: 1 5 


pipe 3 switch #: 7 


input*: 112 


input #: 240 


switch input port #: 0 


switch input port #: 


pipe 0 switch #: 7 


pipe 0 switch #: 15 


pipe 1 switch #: 7 


pipe 1 switch #: 1 5 


pipe 2 switch #: 7 


pipe 2 switch #: 1 5 


pipe 3 switch #: 7 


pipe 3 switch #: 1 5 


input #: 113 


input #: 241 


switch input port #: 1 


switch input port #: 


pipe 0 switch #: 7 


pipe 0 switch #: 15 


pipe 1 switch #: 6 


pipe 1 switch #: 14 


pipe 2 switch #: 5 


pipe 2 switch #: 1 3 


pipe 3 switch #: 3 


pipe 3 switch #: 1 1 



34 
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input n: l 14 
switch input port #: 2 
pipe 0 switch #: 7 
pipe 1 switch #: 5 
pipe 2 switch #: 3 
pipe 3 switch #: 15 

input #: 115 
switch input port #: 3 
pipe 0 switch #: 7 
pipe 1 switch #: 4 
pipe 2 switch #: 1 
pipe 3 switch #: 1 1 

input »: 1 16 
switch input port #: 4 
pipe 0 switch 7 
pipe 1 switch #: 3 
pipe 2 switch #: 15 
pipe 3 switch 4 

input ». ! 17 
switch input port #: 5 
pipe 0 switch #: 7 
pipe 1 switch #: 2 
pipe 2 switch #: 13 
pipe 3 switch #: 0 

input »: 1 18 
switch input port #: 6 
pipe 0 switch #: 7 
pipe 1 switch #: 1 
pipe 2 switch #: 1 1 
pipe 3 switch #: 12 

input »: 1 19 
switch input port #: 7 
pipe 0 switch #: 7 
pipe ! switch #: 0 
pipe 2 switch #: 9 
pipe 3 switch #: 8 



input #: 242 

switch input port #: 2 
pipe 0 switch #: 15 
pipe 1 switch #: 13 
pipe 2 switch #: 1 1 
pipe 3 switch #: 7 

input #: 243 

switch input port #: 3 
pipe 0 switch #: 15 
pipe 1 switch #: 12 
pipe 2 switch #: 9 
pipe 3 switch #: 3 

input #: 244 

switch input port #: 4 
pipe 0 switch #: 15 
pipe 1 switch #: 1 1 
pipe 2 switch #: 7 
pipe 3 switch #: 12 

input #: 245 

switch input port #: 5 
pipe 0 switch #: 1 5 
pipe 1 switch #: 10 
pipe 2 switch #: 5 
pipe 3 switch #: 8 

input #: 246 

switch input port #: 6 
pipe 0 switch #: 15 
pipe 1 switch #: 9 
pipe 2 switch #: 3 
pipe 3 switch #: 4 

input #: 247 

switch input port #: 7 
pipe 0 switch #: 1 5 
pipe 1 switch #: 8 
pipe 2 switch #: 1 
pipe 3 switch #: 0 
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input #: 120 
switch input port #: 8 
pipe 0 switch #: 7 
pipe l switch #: 15 
pipe 2 switch #: 4 
pipe 3 switch #: 1 
input #: 121 
switch input port #: 9 
pipe 0 switch #: 7 
pipe 1 switch #: 14 
pipe 2 switch #: 6 
pipe 3 switch #: 5 

input #: 122 
switch input port #: 10 
pipe 0 switch #: 7 
pipe 1 switch #: 13 
pipe 2 switch #: 0 
pipe 3 switch #: 9 

input #: 123 
switch input port #: 1 1 
pipe 0 switch #: 7 
pipe 1 switch #: 12 
pipe 2 switch #: 2 
pipe 3 switch #: 13 

input #: 124 
switch input port #: 12 
pipe 0 switch #: 7 
pipe I switch #: 1 1 
pipe 2 switch #: 12 
pipe 3 switch #: 2 



input #: 248 

switch input port #: 8 
pipe 0 switch #: 15 
pipe 1 switch #: 7 
pipe 2 switch #: 12 
pipe 3 switch #: 9 

input #: 249 

switch input port #: 9 
pipe 0 switch #: 15 
pipe 1 switch #: 6 
pipe 2 switch #: 14 
pipe 3 switch #: 13 

input #: 250 

switch input port #: 10 
pipe 0 switch #: 15 
pipe 1 switch #: 5 
pipe 2 switch #: 8 
pipe 3 switch #: 1 

input #: 251 

switch input port #: 1 1 
pipe 0 switch #: 15 
pipe 1 switch #: 4 
pipe 2 switch #: 10 
pipe 3 switch #: 5 

input #: 252 

switch input port #: 12 
pipe 0 switch #: 15 
pipe 1 switch #: 3 
pipe 2 switch #: 4 
pipe 3 switch #: 10 



input #: 125 
switch input port #: 13 
pipe 0 switch #: 7 
pipe 1 switch #: 10 
pipe 2 switch #: 14 
pipe 3 switch #: 6 



input #: 253 

switch input port #: 13 
pipe 0 switch #: 15 
pipe 1 switch #: 2 
pipe 2 switch #: 6 
pipe 3 switch #: 14 
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input #: 254 

input #: 126 switch input port #: 14 

switch input port #: 1 4 Q switch # . 1 5 

pipe 0 switch #: 7 p . pe t switch # . ! 

pipe 1 switch #: 9 2 switch #: 0 

pipe 2 switch #: 8 3 sWitch #: 2 
pipe 3 switch #•• 10 

input #:255 

input #: 127 switch input port #: 1 5 

switch input port #: 1 5 p£ Q switch #: 1 5 

pipe 0 switch #: 7 t switch #: 0 

pipe 1 switch #: 8 pi pe 2 switch #: 2 

pipe 2 switch #: 10 3 gwitch #: 6 

pipe 3 switch #: 14 FP 



systems. 
Claims 



ms , a nluralitv of input lines to a plurality of output lines, 

an out of band controller. 

3 The packet switch as set forth in clairr a telecomm unication PJ** which was unable to 
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find an unblocked path through both a first pipe and a second pipe to an input of a pipe controller of a third pipe and 
the telecommunication packet is stored in said input interface while the controller is hunting an unblocked path. 

5. The packet switch as set forth in claim 2, wherein: 

each of said input interfaces has a store for storing a telecommunication packet; and 
said out-of-band controller rolls a request for a path for the telecommunications packet which was unable to 
find an unblocked path through a first pipe, a second pipe and a third pipe to an input of a pipe controller of a fourth 
pipe and the telecommunication packet is stored in said input interface while the controller is hunting an unblocked 
path. 

6. The packet switch as set forth in claim 2, wherein said out-of-band controller assigns an order of preference to ATM 
cells to reduce a probability of losing an ATM cell by internal blocking. 

7. The packet switch as set forth in claim 2, wherein said out-of-band controller assigns an order of preference to ATM 
cells, and rolls a request fcx a path for a telecommunications packet which was unable to find an unblocked path 
through a first ppe to an input of a pipe controller of a second pipe. 

8. The packet switch as set tort* m claim 2, wherein said out-of-band controller assigns an order of preference to ATM 
cells, and rolls a request tor a path for a telecommunications packet which was unable to find an unblocked path 
through a first ppe and a second ppe to an input of a pipe controller of a third pipe. 

9. The packet switch as &#t tort* n daim 2. wherein said out-of-band controller assigns an order of preference to ATM 
cells, and rolls a request tor a path for a telecommunications packet which was unable to find an unblocked path 
through a first ppe a &«cond ppe and at third pipe to an input of a pipe controller of a fourth pipe. 

10. A packet switch for swrichmg telecommunication packets, comprising: 

a network for swrtchng a plurality of I inputs to a plurality of P outputs; 

said network having a plurality of C pipes, where C is an integer of a value equal to P/l; 

each pipe having a respective pattern of switching its inputs to its outputs; 

each pattern o» switching of a pipe is independent of the patterns of switching of the other pipes; 

a plurality of output modules connected to said plurality of P outputs; and 

means for huntng a path through said packet switch for a telecommunication packet. 

11. The packet switch as set forth in claim 10, wherein said path hunting means comprises: 

an out of band controBer. 

12. The packet switch as set tortn n daim 1 1 , wherein said out-of-band controller rolls a request for a path of a tele- 
communication packet when was unable to find an unblocked path through a first pipe to an input of a second pipe. 

13. The packet switch as set tortn «i daim 1 1 , wherein said out-of-band controller rolls a request for a path of a tele- 
communication packet wfKh was unable to find an unblocked path through both a first pipe and a second pipe to 
an input of a pipe controilef of a third pipe. 

14. The packet switch as set torn in daim 1 1 , wherein said out-of-band controller rolls a request for a path of a tele- 
communication packet which was unable to find an unblocked path through a first pipe, a second pipe and a third 
pipe to an input of a ppe controller of a fourth pipe. 

15. The packet switch as set torth n claim 11, wherein said out-of-band controller assigns an order of preference to 
ATM cells to reduce a probability of losing an ATM cell by internal blocking. 

16. The packet switch as set torth in claim 1 1 , wherein said out-of-band controller assigns an order of preference to 
ATM cells, and rolls a request tor a path of a telecommunications packet which was unable to find an unblocked 
path through a first pipe to an input of a pipe controller of a second pipe. 

17. The packet switch as set forth m claim 11, wherein said out-of-band controller assigns an order of preference to 
ATM cells, and rolls a request for a path of a telecommunication packet which was unable to find an unblocked path 
through a first pipe and a second ppe to an input of a pipe controller of a third pipe. 
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18. The packet switch as set forth in claim 1 1 , wherein said out-of-band controller assigns an order of preference to 
ATM cells, and rolls a request for a path of a telecommunications packets which was unable to find an unblocked 
path through a first pipe, a second pipe and a third pipe to an input of a fourth pipe. 

19. The packet switch as set forth in claim 1 1 , wherein said out-of-band controller controls finds and establishes paths 
through said packet switch for the telecommunication packets. 

20. An ATM switch for switching ATM packets, comprising: 

a plurality of ATM interface cards, each having a respective input connected to an ATM telecommunication 
line and an output; 

a network for switching a plurality of I inputs to a plurality of P outputs; 

said network having a plurality of F pipes, where F is an integer of a value equal to P/l; 

each of said outputs of said input interfaces is fanned out by a factor of F and connected a respective input 
of each of sad F pipes; 

each pipe having a respective pattern of switching its inputs to its outputs; 

each pattern of switching of a pipe is independent of the patterns of switching of the other pipes, 

a plurality of output modules connected to said plurality of P outputs; 

each of sari output modules having a plurality of outputs; and 

means fa hunting a path from an input of one of said plurality of input interfaces through said ATM switch for 
an ATM packet to a desired output of one of said plurality of output modules. 

21. The ATM switch according to claim 20, wherein an input interface of said plurality of input interfaces has a memory 
that stores an ATM packet for two ATM packet periods to allow said means for hunting a path to hunt a path for an 
ATM packet which was blocked during the previous ATM packet period from an input of one of said plurality of input 
interfaces through said ATM switch for an ATM packet to a desired output of one of said plurality of output modules 
during the next ATM packet period. 

22. The ATM switch according to claim 21 , wherein said ATM packet which was blocked during the previous ATM packet 
period is communicated through said ATM switch to its respective desired output of its output module in proper 
sequence without the use of a time stamp. 

23. A method for communicating a telecommunication packet through a packet switch having a plurality input interfaces, 
each of said input interfaces having a store for storing a telecommunications packet, and a plurality of pipes, said 
method comprising the steps of: 

a. storing a telecommunication packet in an input interface; 

b. hunting during a first time period a non-blocked path for said telecommunication packet through a first pipe 
to an output module which is connected to a destination output line; 

c. if a non-blocked path is found through said first pipe skipping to step k, otherwise continuing to step d; 

d. if a non-blocked path is not found through said first pipe, hunting during a second time period a non-blocked 
path for said telecommunication packet through a second pipe to the output module which is connected to the 
destination output line ; 

e. if a non-blocked path is found through said second pipe skipping to step k, otherwise continuing to step f ; 

f. if a non-blocked path is not found through said second pipe in the second time period, hunting in a third time 
period a non-blocked path for said telecommunication packet through a third pipe to the output module which 
is connected to the destination output line; 

g. if a non-blocked path is found through said third pipe skipping to step k, otherwise continuing to step h; 

h. if a non-blocked path is not found through said third pipe in the third time period, hunting in a fourth time 
period a non-blocked path for said telecommunication packet through a fourth pipe to the output module which 
is connected to the destination output line; 

i. if a non-blocked path is found through said fourth pipe skipping to step k, otherwise continuing to step j; 

j . if a non-blocked path is not found through said fourth pipe in the fourth time period, clearing said telecommu- 
nication packet from said input interface and losing said telecommunication packet; 
k. communicating said telecommunication packet from said input interface to an output modulethat is connected 
to the desired output line; and 

I. routing said telecommunication packet through said output module to said desired output line. 
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24. A method for communicating an ATM packet through a packet switch having a plurality input interfaces, each of said 
input interfaces having a store for storing an ATM packet , and a plurality of pipes, said method comprising the steps 
of: 

a. communicating an ATM packet from an input line to an input interface of said plurality of input interfaces; 

b. determining from a header of said ATM packet a destination output line and forwarding said destination output 
line determination to an out-of-band controller; 

c. storing said ATM packet in said input interface; 

d. hunting during a first half of a first ATM packet time period a non-blocked path for said telecommunication 
packet through a first pipe to an output module which is connected to the destination output line; 

e. if a non-blocked path is found through said first pipe skipping to step m, otherwise continuing to step f ; 

f. if a non-blocked path is not found through said first pipe, hunting during a second half of said first ATM packet 
time period a non-blocked path for said ATM packet through a second pipe to the output module which is con- 
nected to the destination output line ; 

g. if a non-blocked path is found through said second pipe skipping to step m, otherwise continuing to step h; 

h. if a non-blocked path is not found through said second pipe in the second half of said first ATM packet time 
period, hunting in a first half of a second ATM packet time period a non-blocked path for said ATM packet through 
a third pipe to the output module which is connected to the destination output line; 

i. if a non-blocked path is found through said third pipe skipping to step m, otherwise continuing to step j; 

j. if a non-blocked path is not found through said third pipe in the first half of said second ATM packet time period, 
hunting in a second half of said second ATM packet time period a non-blocked path for said ATM packet through 
a fourth pipe to the output module which is connected to the destination output line; 
k. if a non-blocked path is found through said fourth pipe skipping to step m, otherwise continuing to step I; 
I. if a non-blocked path is not found through said fourth pipe in the fourth time period, clearing said ATM packet 
from said input interface and losing said ATM packet; 

m. communicating said ATM packet from said store of said input interface to said output module that is connected 
to said destination output line; and 

n. routing said ATM packet through said output module to said destination output line. 

25. A method for communicating an ATM packet through a packet switch having a plurality input interfaces, each of said 
input interfaces having a store for storing an ATM packet , and a plurality of pipes, said method comprising the steps 



a. communicating an ATM packet from an input line to an input interlace of said plurality of input interfaces; 

b. determining from a header of said ATM packet a destination output line and forwarding said destination output 
line determination to an out-of-band controller; 

c. storing said ATM packet in said input interface; 

d. hunting during a first half of a first ATM packet time period a non-blocked path for said telecommunication 
packet through a first pipe to an output module which is connected to the destination output line; 

e. if a non-blocked path is found through said first pipe skipping to step m, otherwise continuing to step f; 

f. if a non-blocked path is not found through said first pipe, hunting during a second half of said first ATM packet 
time period a non-blocked path for said ATM packet through a second pipe to the output module which is con- 
nected to the destination output line ; 

g. if a non-blocked path is found through said second pipe skipping to step m, otherwise continuing to step h; 

h. if a non-blocked path is not found through said second pipe in the second half of said first ATM packet time 
period, hunting in a first half of a second ATM packet time period a non-blocked path for said ATM packet through 
a third pipe to the output module which is connected to the destination output line; 

i. if a non-blocked path is found through said third pipe skipping to step m, otherwise continuing to step j; 

j. if a non-blocked path is not found through said third pipe in the first half of said second ATM packet time period, 
hunting in a second half of said second ATM packet time period a non-blocked path for said ATM packet through 
a fourth pipe to the output module which is connected to the destination output line; 
k. if a non-blocked path is found through said fourth pipe skipping to step m, otherwise continuing to step I; 
I. if a non-blocked path is not found through said fourth pipe in the fourth time period, clearing said ATM packet 
from said input interface and losing said ATM packet; 

m. communicating said ATM packet from said store of said input interface to said output module that is connected 
to said destination output line; and 

n. routing said ATM packet through said output module to its destination output line such that said ATM packet 
is in an appropriate time sequence with respect to any other ATM packet that received by any of said plurality 
of input interfaces during said first and second ATM packet time periods. 
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26. A method for communicating a plurality ol ATM packets from a plurality of input lines through a packet switch having 
a plurality input interfaces, each of said input interfaces having an input connected to a respective input line of said 
plurality of input lines and a store for storing a respective ATM packet of said plurality of ATM packets, and a plurality 
of pipes, said method comprising the steps of: 

a. communicating each ATM packet from an input line to a respective input interface of said plurality of input 
interlaces; 

b. determining from header data of each ATM packet a respective destination output line; 

c. assigning each ATM packet a first phase preference level that is different from another first phase preference 
level; 

d. communicating said first phase preference level and said destination output line determination to an out-of- 
band controller; 

e. storing each ATM packet in its input interface until it is communicated through one of said plurality of pipes 
or cleared; 

f. hunting during a first half of a first ATM packet time period a non-blocked path for said telecommunication 
packet through a first pipe to an output module which is connected to the destination output line; 

e. if a non-blocked path is found through said first pipe skipping to step m, otherwise continuing to step f ; 

f. if a non-blocked path is not found through said first pipe, hunting during a second half of said first ATM packet 
line period a non-blocked path for said ATM packet through a second pipe to the output module which is con- 
nected to the destination output line ; 

g. if a non-blocked path is found through said second pipe skipping to step m, otherwise continuing to step h; 

h. if a non-blocked path is not found through said second pipe in the second half of said first ATM packet time 
period, hunting in a first half of a second ATM packet time period a non-blocked path for said ATM packet through 
a third pipe to the output module which is connected to the destination output line; 

i. if a non-blocked path is found through said third pipe skipping to step m, otherwise continuing to step j; 

j. if a non-blocked path is not found through said third pipe in thef irst half of said second ATM packet time period, 
hunting in a second half of said second ATM packet time period a non-blocked path for said ATM packet through 
a fourth pipe to the output module which is connected to the destination output line; 
k. if a non-blocked path is found through said fourth pipe skipping to step m, otherwise continuing to step I; 
I. if a non-blocked path is not found through said fourth pipe in the fourth time period, clearing said ATM packet 
from said input interface and losing said ATM packet; 

m. communicating said ATM packet from said store of said input interface to said output module that is connected 
to said destination output line; and 

n. routing said ATM packet through said output module to said destination output line. 

27. A controller for a packet switch for locating a path for each telecommunication packet, comprising: 

memory means for storing a busy-or-idle status for each connection between a single stage switch fabric and 
a plurality of output modules; 

said memory means is divided into a plurality of be-or-idle status tables; and 

means for accessing each of said plurality of busy-or-idle status tables concurrently for locating the path for 
each telecommunication packet to the desired output module of said plurality of output modules. 

28. A controller for a packet switch having a switch fabric having a plurality of pipes with each pipe having a plurality of 
crossbar switches for locating a path for each telecommunication packet, comprising: 

a plurality of pipe hunting controllers, with each of said pipe hunting controllers controlling a respective pipe 
of said plurality of pipes; 

each of said pipe hunting controllers having a plurality of crossbar switch controllers, with each crossbar 
switch of a pipe having a respective crossbar switch controller; 
a plurality of storage means for storing busy-or-idle tables; 

each of said plurality of storage means is associated with a respective crossbar switch controller of said 
plurality of crossbar switch controllers and stores a respective busy-or-idle status table therefor; and 
means for accessing each of said busy-or-idle status tables concurrently. 

29. The controller for a packet switch as set forth in claim 28, wherein each of said busy-or-idle tables has a plurality of 
busy-or-idle status bits with each busy-or-idle status bit corresponding to a busy-or-idle status of a respective output 
of its respective crossbar switch. 

30. The controller for a packet switch as set forth in claim 29, wherein each of said crossbar switch controllers processes 
its plurality of busy-or-idle status bits concurrently. 
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31 . The controller for a packet switch as set forth in claim 29, wherein each busy-or-idle status bit is stored in a respective 
output controller corresponding to the respective output of its respective crossbar switch. 

32. The controller for a packet switch as set forth in claim 31 , wherein each output controller processes one busy-or- 
5 idle bit for controlling its respective output for each packet processing time. 

33. A controller for a packet switch having a switch fabric having a lurality of pipes with each pipe having a plurality of 
crossbar switches for locating a path for each telecommunication packet, comprising: 

a plurality of pipe hunting controllers, with each of said pipe hunting controllers controlling a respective pipe 
w of said plurality of pipes; 

each of said pipe hunting controllers having a plurality of crossbar switch controllers, with each crossbar 
switch of a pipe being controlled by its respective crossbar switch controller; 
a plurality of storage means for storing busy-or-idle tables; 

each of said plurality of storage means is associated with a respective crossbar switch controller of said 
15 plurality of crossbar switch controllers and stores a respective busy-or-idle table therefor; and 

means for accessing each of said busy-or-idle status tables concurrently; wherein each of said storage means 
comprises: 

means for storing a busy-or-idle bit; 

means for reading said busy-or-idle bit from said storage means; 
20 means for logically operating on said busy-or-idle bit with a request bit to produce a resulting busy-or-idle bit 

that is stored in said storage means, a request-out bit and a connect bit; and 

said connect bit cause a path to be connected through its respective crossbar switch if said connect bit is set. 

34. The controller for a packet switch as set forth in claim 33, further comprising: 

25 means for forwarding said request-out bit to another of said plurality of storage means in another pipe to hunt 

a path where said request-out bit is inputted to a respective logical operating means of said another storage means 
and logically operated on with another busy-or-idle bit to produce a resulting busy-or-idle bit, another request-out 
bit and another connect bit. 

30 35. The controller for a packet switch as set forth in claim 33, wherein sixteen request bits are transmitted as a request 
vector to sixteen storage means in parallel. 

36. A method for controlling a packet switch having a switch fabric having a plurality of pipes with each pipe having a 
plurality of NxN crossbar switches, and a plurality of output modules during each packet cycle period, comprising 
35 the steps of: 

setting all busy-or-idle bits to idle at a beginning of each packet cycle period; 

reading N busy-or-idle bits from a busy-or-idle memory of a crossbar switch controller in parallel as a busy- 
or-idle vector; 

performing parallel pipe hunting operations by logically combining said busy-or-idle vector and a first input 
40 request vector to produce a first updated busy-or-idle vector, a connect vector and an output request vector; 
storing said updated busy-or-idle vector into the busy-or-idle memory in parallel; and 
forwarding said connect vector to a first crossbar switch of said plurality of crossbar switches to set a path 
from an input of said switch fabric to an output of said switch fabric for a packet. 

45 37. The method of claim 36 wherein the size of each of the NxN crossbar switches is 1 6X1 6. 

38. The method of claim 36 or 37, further comprising the step of: 

forwarding said output request vector which contains any unfulfilled requests from said input request vector 
to a second crossbar switch controller in another pipe; 
50 using said output request vector as a second input request vector for a second crossbar switch of said plurality 

of crossbar switches connected to and controlled by said second crossbar switch controller; 

reading N busy-or-idle bits from a busy-or-idle memory of said second crossbar switch controller in parallel; 
performing parallel pipe hunting operations logically combining said busy-or-idle vector and said input request 
vector producing a second updated busy-or-idle vector, a second connect vector and a second output request vector ; 
55 storing said second updated busy-or-idle vector into the busy-or-idle memory of said second crossbar switch 

in parallel; and 

forwarding said second connect vector to said second crossbar switch to set a path from an input of said 
switch fabric to an output of said switch fabric for a packet. 
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each of said pipes is a single stage network and provides a single path from any line interface output to an 
output line via an output module of the plurality of output modules; 

each of said output modules having a concentration ratio that is equal in number to the amount of the fan- 
out of the line interface outputs; and 

each path between an input line and its desired output line is sufficiently independent from the other paths 
through the other pipes between that input line and that desired output line that the probability of internal block is 
low 

wherein reducing the number of paths available to connect any input line to any output line to the same as 
the number of pipes substantially reduces the number of active devices needed for connections without an equivalent 
rise in the internal blocking probability. 

51. A packet switch for switching circuit switched communications from a plurality of circuit switched input lines to a 
plurality of circuit switched output lines and packet switched communications from a plurality of packet switched 
input lines to a plurality of packet switched output lines, comprising: 

a plurality of circuit switched input interfaces, each having an input port connected to a respective circuit 
switched input line of said plurality of circuit switched input lines, and each of said circuit switched input interfaces 
having an output port; 

a plurality of packet switched input interfaces, each having an input port connected to a respective packet 
switched input line of said plurality of packet switched input lines, and each of said packet switched input interfaces 
having an output port; 

a single stage switch fabric having a plurality of input ports with a first portion of said input ports connected 
to respective output ports of said circuit switched input interfaces and a second portion of said input ports connected 
to respective output ports of said packet switched input interfaces; 

a plurality of circuit switched output modules, said circuit switched output modules together having a plurality 
of inputs, each of said circuit switched output module inputs connected to respective output port of said first portion 
of said single stage switching fabric, and together having a plurality of outputs, each of said circuit switched output 
module outputs connected to a respective circuit switched output line of said plurality of circuit switched output lines; 

a plurality of packet switched output modules, said packet switched output modules together having a plurality 
of inputs, each of said packet switched output module inputs connected to respective output port of said second 
portion of said single stage switching fabric, and together having a plurality of outputs, each of said packet switched 
output module outputs connected to a respective packet switched output line of said plurality of packet switched 
output lines; 

means for hunting a path through said switch fabric to a desired circuit switched output line for communication 
on each circuit switched input line; and 

means for hunting a path through said switch fabric to a desired packet switched output line for a packet on 
each packet switched input line. 

52. The switch as set forth in claim 51 , wherein: 

said circuit switched communication path hunting means includes a first out of band, controller; 
said packet switched communication path hunting means includes a second out of band, controller; 
said switch fabric is partitioned into multiple pipes; and 

said out-of-band controllers roll requests which have been denied a path through a first pipe to a second pipe. 

53. The switch as set forth in claim 52, wherein said out-of-band controllers roll requests which have been denied a 
path through a first pipe and a second pipe to a third pipe. 

54. The switch as set forth in claim 52, wherein said out-of-band controllers roll requests which have been denied a 
path through a first pipe, a second pipe and a third pipe to a fourth pipe. 

55. The switch as set forth in claim 52, wherein said second out-of-band controller assigns an order of preference to 
communication packets. 

56. The switch as set forth in claim 51 , wherein a size of said first portion of said switch fabric is in a range of zero to 
one hundred per cent. 

57. The switch as set forth in claim 56, wherein a length of each communication packet may vary from one packet to 
another. 



<EP 072041 3A2J. 



EP 0 720 413 A2 



58. The switch as set forth in claim 51 , 52, 53, 54, 55, 56 or 57, wherein a length of each communication packet may 
vary from one packet to another. 

59. A packet switch as set forth in claims 1 or 10, further comprising 

a spare pipe for on-line replacement of any one of said C pipes which is faulty. 

60. A growable packet switch for switching packets of data from a plurality of input lines to a plurality of output lines, 
comprising: 

a plurality of input interfaces, each having an input port connected to a respective input line of said plurality 
of input lines, and an output port; 

a single state distribution network for switching a plurality of I input ports to a plurality of L output ports; 

each of said input interfaces having a store therein for holding a packet of data until the packet of data is 
routed to the network; 

each of said plurality of input interface output ports fanning out to a respective group of F of said I input ports 
of said single stage distribution network; 

said single stage distribution network having a plurality of P partitions, where P is an integer; 

a plurality of output modules, said output modules together having a plurality of inputs, each of said output 
module inputs connected to respective output port of said plurality of L output ports, and together having a plurality 
of outputs, each of said output module outputs connected to a respective output line of said plurality of output lines; 

an out-of-band controller having a plurality of busy-idle memory units equal in number to the number of 
partitions P, each of said busy-idle memory units controls the routing of data packets through its respective partition; 
and 

each partition of said P partitions having at least one path from each of the plurality of inputs lines that is 
connectable to a respective output line of the plurality of output lines. 

61 . The growable packet switch for switching packets of data from a plurality of input lines to a plurality of output lines 
according to claim 60, 

wherein each data packet routing request that is made in an i-th time interval is completed in either the i-th 
time interval or in the next subsequent time interval. 

62. The growable packet switch for switching packets of data from a plurality of input lines to a plurality of output lines 
according to claim 61 , wherein each of said output modules takes data from its FIFOs such that a cell communicated 
via an input line in the i-th interval that was routed in the next interval after the i-th interval will be output to the 
desired output line before any other cell that is communicated via said input line in any interval after the i-th interval. 

63. The growable packet switch for switching packets of data from a plurality of input lines to a plurality of output lines 
according to claim 61, wherein said single stage distribution network is a single electronic crossbar switch. 

64. The growable packet switch for switching packets of data from a plurality of input lines to a plurality of output lines 
according to claim 61 , wherein said single stage distribution network is an isomorph of a single electronic crossbar 
switch which has a plurality of partitions and each partition is a single electronic crossbar switch. 

65. The growable packet switch for switching packets of data from a plurality of input lines to a plurality of output lines 
according to claim 61 , wherein said single stage distrbution network has a plurality of partitions and each partition 
has a plurality of electronic crossbar switches, and each partition has at least one path connectable between each 
input line and each output line. 

66. The growable packet switch for switching packets of data from a plurality of input lines to a plurality of output lines 
according to claim 61 , wherein any routing request that arrived during the i-th interval attempts to locate an available 
path in the i-th interval or in the next subsequent interval to the i-th interval. 

67. A growable packet switch for switching packets of data from a plurality of input lines to a plurality of output lines 
according to claim 61 , wherein any routing request that arrived during the i-th interval and passes from busy-idle 
memory (P-1) to busy-idle memory 0 attempts to locate available paths through the remaining partitions during the 
next interval alter the i-th interval. 



68. A method for controlling paths for X ATM cells entering a growable packet switch during an i-th arrival interval that 
are destined to a common mxn output packet module with X>m, comprising the steps of: 
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routing m of said X ATM cells during an i-th routing interval; and 

rolling the remaining X-m of said X ATM cells into a next routing interval for routing to the output packet module. 
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